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Preamble 


Health planners and administrators committed to the development of community based 
primary health care as the most effective means of achieving HFA/2000 are confronted by a 
wide variety of pressing practical problems. These include the need to assess health 


service needs in particular populations and to define appropriate manpower requirements, the 
need to create suitable training programmes and to effect their implementation, the need to 
select appropriate people to be trained and, through effective management, assure their 
effective functioning as healtn service personnel and, finally, the need to be aware of and 
assess the potential and actual impacts of this health systems planning and implementation 
on tne target populations. This series of problems may be viewed from a number of different 


perspectives; for example, what are the cultural, political and economic contexts in which 
these problems occur? Additionally, are the specific health related concerns national, 
regional or with reference to city, village or individual? 


The achievement of a better understanding of these kinds of problems and their effective 
resolution may be facilitated with the skilful use of a variety of social and behavioural 


science research approaches. Unfortunately, the conventionally trained researcher, health 
planner, administrator, and practitioner usually relates only to the limited range of 


research approaches tnat are consistent with his disciplinary roots. As biomedical 


researcher, sociologist, anthropologist, psychologist, economist or educator he may not be 
aware of a wider range of available research approaches and the utility of many of these 
approaches in the investigation of particular HMD problems. 


It is witn the need of such professionals in mind that an Interregional Consultation was 
held in July 1982. 


The Objectives of the Consultation were the following: 


1. To review the major researchable problems in Health Manpower 


Development and identify and describe the research methodologies 


which could be applied to the study of HMD research as part of Health 
Systems Research, 


Da To identify the advantages and limitations of these different research 
methodologies. 


3 To develop guidelines for selecting appropriate research methods for 
solving HMD problems and for technical assessment of research applications. 


4. To identify the reasons why research methods which could be used are 


not being widely used at present and recommend specific actions to be 
taken to promote the credibility and use of these methods and where 


necessary determines the training requirements to meet these methods. 


The meeting was organized in collaboration between the Division of Strengthening of 
Health Services and the Division of Health Manpower Development, Geneva, and with the 


Regional Oftice for South East Asia, New Delhi. It was opened by Dr U. Koko, Regional 
Director (See inaugural address in Appendix I page 67) and included 12 experts assisted by 


tne WHO Secretariat (See list in Appendix II page /0). 
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The present document which summarizes the interventions and opinions of the 


articipants during the meeting was drafted by Professor A.l. Rothman, Division of Studies 
in Medical Education, Faculty of Medicine, University of Toronto, Canada. It presents a 


wide variety of available social and _ behavioural science research approaches and 
methodologies and to do this with reference to appropriate case illustrations. A selected 
number of research approaches are defined and described - each with particular reference to 
purposes, and methodology. Criteria for their selection are indicated, their advantages and 


disadvantages identified, and the reader is directed to selected sources for clear and 
detailed instruction concerning specific methodology and application. 


Since, in the HMD context, research is intended to assist the development of effective 
community based health systems, an improvement of communications between researchers and 
health planners and administrators is required. Therefore, in addition to introducing 
potential researchers to social and behavioural science research approaches, the document 
will attempt to sensitize planners and administrators to the possible usefulness of these 
approaches. 


Introduction 


The following list of assumptions is a distillation of the opinions expressed by the 
participants and are basic to the development of this document. 


1. Problems confronted in the development of community based primary health care systems 
are real. If research is to be instrumental in the resolution of these problems, 
research approaches and designs must match these problems as they present. The problems 
confronted cannot be changed to conform to the specific requirements of particular 


research approaches and designs. It follows, therefore, that some problems or aspects 
of some problems may not be researchable. 


2. Many HMD problems may be usefully investigated through the separate and joint use of 
several research approaches. 


3. To deal effectively with these problems it is necessary to conceptualize them clearly 
and to have a thorough understanding of their social and political contexts. 


4. For the types of problems encountered in HMD, -research will be best planned and 
supervised by health care professionals familiar with a wide range of social and 
behavioural science research approaches. 


Social and behavioural science research on HMD problems can sometimes provide results 
that will assist in effective decision-making. 


THE EXPERIMENT 


The primary purpose of an experiment in the social and behavioural sciences is 
hypothesis verification. It achieves this by testing specific propositions about 
associations and causal relationships; for example, that A is associated with B or that A 
causes B. It is assumed that through continued experimentation involving many such 
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variables, principles will be discovered that will Ppa 

complex social and behavioural phenomena. These se ys be $ loarer understanding about 
already occurred and been observed. The process of sunetiomebanin unk 
at the growth of understanding through the : 
principles. 


beyond what has 
therefore, is directed 


emergenc 
gence of more comprehensive and useful 


Methodology 


In the i 

Pp i Ps Cake ame ie pica tei of this research approach involves an experimental 

‘pulation of one variable in a situation otherwise held constant 
The deliberate manipulations of the investigators are treatments and are 
‘quantitatively as independent variables. The consequences of the tte ie Pig 
are outcomes represented quantitatively as dependent variables. Ideally, if the results of 
an experiment are to be generalized to a large group of people, (or districts, villages 
families, etc.,) those actually participating in the experiment (the cemalian must te 
randomly selected from that group. To ascribe effect to the experimental cchatnent the 
investigator must compare two similar groups who differ only with respect to the presence or 
absence of this treatment. The equivalence of these two groups prior to the experiment is 
achieved by the random assignment of people from the original sample to either treatment or 
non-treatment (control) groups. The absence or presence of experimental effects is usually 
established using the logic and methods of inferential statistics. 


The distinction between the two principal functions of randomization in experimental 
research relating to social phenomena is worth reiterating. The drawing of a random sample 
that is representative of a population of interest allows generalization of research results 
to that population. The random assignment of subjects to groups (control and experimental) 
so as to ensure the equivalence of these groups is a necessary condition in drawing 
conclusions about cause and effect. These two randomization functions are independent and 
must be considered separately in the conceptualization of research problems. 


Figure 1: A True Experimental Design 


POPULATION 


REPRESENTATIVE 
random 


selection assignment 
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nly observations 
Figure 1 describes a true experimental design. In the figure, the only 


i nt. 
(measurements 0, and 09) are made after the experimental treatme 
he two groups 
1. Because of random assignment of subjects to treatment and control groups t Z Pp 
can be assumed to be equivalent. 


test the proposition of the presence of an 


2. A comparison of 0, and 09 will 
experimental effect (verification). 


3. Because random selection from the population of interest provides a representative 


sample, results can be generalized to that population. 


Criteria for Using an Experiment 
MESESEERS: +O ase 6) See 


l. When effectiveness of specific treatments, programmes or programme components are to be 


verified, and 
2. When random assignment is possible, and 


3. When it is possible to maintain access to and to effectively separate (isolate) the 
treatment and control groups for the term of the experiment. 


QUAS I-EXPER IMENTS 


In many field settings random assignment is not possible and maintaining effective 
experimental control is a problem. In these situations modified experimental approaches are 
available that attempt to accommodate for the absence of random assignment and for the 
various problems with experimental control. These modified approaches are called 
quasi-experiments. For example, instead of random assignment a matching process can be used 
in the assignment of subjects to treatment and control groups. With this type of design, 


measurements of both groups prior to the experimental treatment can be done to test the 
assumption of treatment - control group equivalence. 


The purposes of quasi and true experimentation are essentially the same. 
Criteria for Selecting a Quasi-Experimental Approach 


1. When effectiveness of treatments, programmes or programme components is to be verified, 
and 


2. When the problem of concern can be investigated only in a field setting which does not 
permit random assignment of subjects to treatment and control groups and where 
maintaining rigourous experimental control is a problem. 


Advantages of Using Experimental or Quasi-Experimental Approaches!» 4 


1. Results are generalizable (with varying degrees of confidence) ; 


2. Results are quantitative; 


3. The design process requires researchers to focus on important variables; 


4. The process is viewed as scientific and hence has credibility with planners and 
administrators. 


Disadvantages 


1. Usually the total time involved from planning to reporting is considerable. Therefore, 
when decisions have to be made rapidly experiments are not suitable; 


Ze Experiments in field settings require high levels of expertize for competent design, 
implementation, analysis and reporting; 


3. The analysis of data can require sophisticated computing equipment; 
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4. Experiments are dependent on accurate measurement. When the researcher's i is i 
. 
complex social phenomena, the development of valid measurement techni re gee. 
serious problems that are both time consuming and costly to resolve ques can present 


5. Experiments are i iti odin 
: e insensitive to outcomes not explicitl ici 
design; y anticipated in the research 


6. Results of quasi-experiments done in field setti 
ttings may be diffic 
: ult 
across time and to other contexts, to" gtneretine 
7. Intentionally manipulating health related factors f 
: : nee Or purposes of experi i 
field settings can raise difficult ethical problems. perianDseees 


Reporting 


Reporting of a true or quasi-experiment requires first a precise definition of the 
research problem placed in the context of what is already known. Second, precise 
descriptions of the populations of interest, the sampling procedures, the research design 
(see Figure 1), the methods of observation (measurements) and the methods of data analysis 
are needed. Third, a summary of the data along with the results of the data analysis are 
necessary. These results are then described, explained and placed in the context of the 
"larger body of knowledge". 


The writing style is impersonal, precise and is intended to provide an impression of 
scientific objectivity. The major virtue of the well written report is that it presents as 
an honest, unambiguous accounting of the experiment in sufficient detail so as to permit 
replication. 


An Example 


What is the best way to stimulate a particular category of health workers in a 
given geographic region to continue their own education? 


Ideally, health workers in the category of interest in the region would be randomly 
assigned to a number of groups. One group, the control, would not be given any 
incentive for continuing education. Each of the other groups would be systematically 
motivated in a unique manner. For example, the members of one group might be paid a 
nominal amount of money for successfully completing professional training courses. The 
different motivational treatments would constitute different values of the independent 
variable. The dependent variable could consist of a measure of the rate of after 
treatment participation in continuing education. Comparisons between groups and with 
the control would establish whether these health workers can be effectively motivated to 
continue their education, and if so, which of the methods tested is the most effective. 


Because random assignment to groups is probably not possible, a quasi-experimental 
approach is more appropriate. Consider the Following design where X Pepeseenee ° 


motivational approach (TREATMENT), and 0 represents the frequency of participation in 
continuing education in one year (OBSERVATION) . 


Ay 0 
ee 


- 0 (no treatment ) 


HMD/83. 3 
Page 6 


These groups of health workers have not. been randomly formed. ie ge erence ae 
attempted to achieve group equivalence through matching and assumes tha : ee 
the. observations caftem-: a cRarLOe) 1 Os. 3ONE) ndieah SAre attributable to, , the asco 
differences. However, because there have been no determinations ot. tet ted 
continuing education activity, observed differences after one year ial goose ce 
inherent group differences in spite of the matching oF y&O the treatmen e é 
both. Moreover, if there are no noticeable differences 1n the observations ER tts 
year, the researcher will have difficulty attributing this to the ineffectiveners fo) 1S 
motivational treatments, for this result may also be due to communication between pe 
experimental groups (this 1s called contamination and reflects lack of experimenta 


control). 


If the researcher had prepared for this investigation prior to imitiating the 
different motivational approaches, the following design may have been more appropriately 


used. 


0 0 (no treatment ) 


As before, the health workers have not been randomly assigned to the experimental 
and control groups. However, by comparing the groups prior to treatment (by comparing 


the 0) values), the researcher is in a better position to identify the impacts of the 
different motivational approaches. In each of these designs precise descriptions of the 
methods used to form the experimental and control groups of health workers are essential. 


Other Example Problems 


7 To assess the effectiveness and impacts of learning objectives on the training of 
health workers. 


a To determine the optimum time required to train personnel for the actual work they 
do as health workers. 


3 To evaluate the suitability of learning materials used in the training of health 
workers. 


= To evaluate the effectiveness of a programme for the training of health workers. 


= To identify the most effective means of disseminating information including 
research findings. 


Ideally, each of these examples might be investigated using a true experimental design. 
In practice the investigation of these problems in their respective field settings will 
probably require quasi-experimental designs. ? 


A published account of a randomized (true) experiment relating to HMD is provided as 
further illustration. It describes the assessment of the effects of substituting nurse 
practitioners for physicians in primary care practice. This publication has been chosen 
because it involves an important and complex HMD_ problem that has been clearly 
conceptualized by the researchers. The research design is appropriate to the problem and 
the measurement procedures have apparently been competently developed and employed. The 
report is brief but complete and the descriptions of the research problem, research sample, 
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methodology and results are clear The di 

: : 1scussion links the ; 

developing body of knowledge concerned with primary health care Pe Se not only with the 

actual context of the study, the health care system in Ontario Canade® a also with the 
; see Annex I). A 


published description of a i> ' 
quasi-experiment relat ’ 
jes ing to HMD and involving the following 


0, 0, (no treatment) 


is also provided In this study subjects were 

: ‘ not randomly assi 
experimental groups, but an attempt was made to achieve group pe At ee _— 
purpose of the research was to evaluate a workshop on rehabilitation eng pn he 
health professionals involved in rehabilitation? (see Annex II). psychiatry for 


THE SAMPLE SURVEY 


jemennen survey is used to gain knowledge about a population by systematically gathering 
on from a representative sample of that population using survey techniques (e 
questionnaires, interviews). The primary purposes of sample surveys are to describ int 
explain. For example, with reference to a large group of people, sample surveys are el 
of describing health care needs, the use of health services, the effects both siticipated 
and unintended of health care, and the acceptability of health services. In eatin 
sample surveys can contribute to the understanding of health care issues. For example “ 
sample survey can be used to explain why a particular group of people does not make better 
use of available health care facilities, and why certain aspects of health care organization 
in a particular region interfere with primary care delivery. In general, the analytical 
purpose is achieved by formulating and testing hypotheses about relationships between 
variables of interest to the researcher. 


It is worth noting that investigations involving sample surveys may also have 
educational and social development functions. For example, a survey may stimulate public 
interest in a particular topic - public interest that will lead to desirable public or 


community action. 


Methodology® 


A sample survey achieves its descriptive. and/or analytical purposes by systematically 
collecting data and by providing statistical summaries of these data. Data are collected by 
administering structured interviews and questionnaires to a sample of people drawn from a 
population of interest. 


Briefly, the steps in this research process are as follows: 


1. The research problem(s) is/are identified and conceptualized. Research objectives are 


defined; 


2. Planning includes: 


a) a search of relevant documents and literature; 


b) the identification and description of the population of interest, 

c) the identification of variables of interest; 

d) the determination of the most appropriate sampling approach; 

e) the selection and preparation of appropriate measurement approaches and materials; 


£) the definition of hypotheses Co be tested. 
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a 


4. 


3% 


in 


Data collection procedures and materials are pretested; 
The data are collected, processed and analyzed. 


The results of the investigation are reported. 


: i e i i V j ioned the study 
I ’ P ssible, to involve th u : 


the planning process so as to increase the probability of their appropri 


the study's results. 


to 


Criteria for the Selection of a Sample Survey 


When a description of what exists or is happening in a population is required; 


When an explanation of what is happening in a population is required but for practical 


reasons experimentation is not possible. For example, when programme changes are 
occurring and periodic monitoring is required; when a programme (C0 be evaluated 
operates nationally, thus eliminating the possibility of finding a representative 
control group; when a programme to be evaluated is in process with no preprogramme 
measures available. 


Advantages 
If programme assessment results are required by health planners or administrators, 
useful information can frequently be provided more quickly by using survey methods than 


by experimentation. 


Descriptive and analytical procedures allow for precise statements of results of sample 
surveys. 


A sample survey can identify and quantify unintended outcomes of health care in a 
population. 


Disadvantages 


Sample surveys require highly trained personnel as well as _ significant technical, 
administrative, data processing and clerical support. 


Data from sample surveys tend to be viewed as "soft" by health planners’ and 
administrators. 


If interviews are used, procedures for minimizing interviewers’ biases and eliminating 
dishonesty are required. 


Extensive pretesting is required to assure the validity of data collection methods. 


The conclusions of a single sample survey are at best only tentative predictors of what 
might happen at another time and in another place. 


A single sample survey is limited in its ability to deal with questions of social change. 


Reporting 


The remarks that appear earlier about reporting the results of experiments apply equally 
sample survey research. 


> 2 ee oe ee 
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An Example 


As part of the process of regional health planning, a 
requests some guidance in defining the financial vebihenan re on oe 
continuing education of several categories of non-physician heal ; neo — 
put horde: es prt ales a ik dade aS vere. ealth workers involved in 


This example presents several distinct researc 
example: “How effective are the different saeaiathaenneeenn et: voase Snckeeny for 
the actual demands and prescribed responsibilities of their jobs?" we +a ‘Opens with 
deficiencies in job performance that continuing education might os oe ioe there 
successful are present continuing education programmes in as y+ Another is "How 
functioning of these health workers?" Suring the effective 


Et ts probable that regional epidemiologic data and the results of on-site 
supervision and assessments will identify areas of strength and/or weakness in the 
performance of these workers. A sample survey of the workers may be used 
approach in assessing the effectiveness of the present list of continuing a 
programmes. 

The population of interest consists of ‘n' thousand health workers in 'N' 
categories concerned with the delivery of primary health care at the community level. A 
sample that includes proportional. representation from each of the 'N' worker categories 
in each of the region's administrative districts is required. In considering this 
research problem, useful variables might include, for example: past and present 
participation in continuing education, participation incentives, convenience (distance 
and time), relevance to job, characteristics of instruction, quality of instruction 
instructor characteristics, and participant biographical information such as age, sex; 
marital status, size of immediate family and extent of family responsibilities. 


A questionnaire administered personally by local supervisors (with some modest 
training) could be an effective means of collecting the required data. 


Beyond the descriptive aspects of the study, understanding of the situation could 


‘be facilitated by testing a series of hypotheses. Examples of these are: 


} workers prefer continuing education programmes that are obviously relevant to their 
jobs; 


2. workers prefer continuing education programmes where attendance causes the least 
personal inconvenience and cost; 


we explicit incentives (e.g. payment) increase participation in continuing education 
programmes ; 


4. instructors who are recognized as from the region are more effective instructors 
than those from elsewhere. 


Other Example Problems 


required that describes the functions 


+ An inventory of present health manpower is 
d in community based 


and activities of each manpower category in the region involve 
primary care. . | 


- What are the legitimate health needs and wants of the people in 4a particular 


community? 


; ; ' ve inin 
¢ In a particular region how are private medical practitioners used in the tra R 


of health workers? 


; ? 
What are the consumers' perceptions of the functions of health care teams 


8 
; 
What are the impacts of a rural based training programme for health workers 
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A published account of a sample survey is provided as illustration. The erticle 


; ; This 
describes the evaluation of family planning communicatzone | bb oe sguuaels eiaa at 
illustration is particularly useful in that in addition to providing a clear ) 


e surve 
a well-designed and administered sample survey, the authors explain why 4 Pour as oe: 
rather than an experiment was the more appropriate research approach for this situa 


(see Annex III). 


THE USE OF DOCUMENTARY SOURCES 


The primary purposes of using research approaches based on documentary sources, as with 
sample surveys, are description and explanation. The key distinctions can be found in the 
different perspectives of the two research approaches. First, documents provide the best 
means of studying past events while sample surveys are concerned with describing the 
present. Additionally, research based on the secondary analysis of information in documents 
involves the production of information about topics other than those which were the concerns 
of the original research. Research using documentary sources can be broad in scope or 
focussed, and either quantitative and objective or qualitative and subjective depending on 
the aims ofthe research and the nature of the source materials available. 


Methodology 
Documents commonly available to the researcher include: 


1. Official statistics (e.g. census data, mortality and morbidity data, utilization data) 
and other official documents (e.g. legislation, parliamentary or legislative minutes) ; 


2. Academic and professional materials (e.g. journal publications, scholarly texts, 
archives, data banks); 


3. Popular materials (e.g. newspapers, advertisements, telephone books) ; 
4. Personal documents (e.g. memoirs, diaries, letters). 


When the original data are quantitative, the whole range of statistical techniques 
available to the social scientist may be legitimately used. However, the researcher must be 
aware of the definitions of the data used in the original documents and how the data were 
collected and processed. In addition, he must be able to assess its validity (that. it 
actually represents what it is supposed to represent) and reliability (precision). 


A variety of research designs involving the secondary analysis of data from documentary 
sources are available to the researcher. These include, for example: 


be The pooling of data from multiple sources; 
Zia Trend analysis; 


34 Cohort analysis; 


4. Crosscultural comparisons !9 


Materials with qualitative data may also play an important role. For example, analyses 
of personal documents can provide valuable information about the living conditions 
experiencéd by individuals or social groups, as well as their attitudes related to the 
social issues of the day, their social awareness, and their important life events. In 
addition, content analysis of what appears in the mass media can provide the researcher with 
reflections of the state of social awareness in relation to emerging social problems. 
Analysis of changes in the contents of the mass media can provide the researcher with an 
indication of how these social positions have changed over the time. 


The value assigned to data and the results of analysis should not be dependent on their 
respective forms (quantitative or qualitative). Too often, both researchers and the 


consumers of research results consider qualitative work inferior to work that is 
quantitative, 
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Criteria for the Use of Documentary Sources 


The use of documentary sources may be the o 
: nly approach ' 
can deal with certain kinds of problems. For example svailable £0. the neagarchen that 


patient and hospital records; when the sco 

pe of the proble 

collection of data (e.g. to describe the relationship are, Be beegludas ine ectual 

health); when the problem refers to events that have occurred in ven’ ay PE 

retrospective study of national or regional trends in the prevalence os pnts Velie P 
of a particular 


medical audits require the use of 


disease). 


A review of available documentary sources can provide a summar f th " 
knowledge in a given area, and should be an early step in hatiamberen oC ae oF 
area of activity new to him. It should be assumed that a researcher will be aware of 

oO 


existing documentary information relating to his work, i . 
» lrrespective of the 
approach he commonly uses. research 


Advantages 


Large amounts of data from both official and private sources may be available to the 
researcher. The quantity and quality of data in archives is growing. Access to stored 
data is being facilitated by the advent of computer-based data and information retrieval 
systems. 


Important advantages of this approach are its economies of time and resources. These, 
along with the "essence" of respectability associated with published documents, make 
this an attractive approach for health planners and decision-makers. 


Secondary analysis of existing data is particularly useful when the collection of new 
data (e.g. with a survey) in a given situation will be intrusive. 


This type of research can be done by an individual researcher. It does not require the 
collaborative interaction nor the extensive funding characteristic of large research 
groups. 


Because of the low costs associated with research of this kind and the vast array of 
available and accessible documentary sources, secondary analysis provides a powerful 
alternative avenue for the training of HMD researchers. 


Through the secondary analysis of data from different countries the researcher may 
examine problems in a comparative way. By considering data from different time periods 
the researcher may investigate change. 


Disadvantages 


Required documents may not be available to the researcher. 


In some countries it is not unusual for official documents containing, for example, 
vital statistics, manpower data and hospital records to be incomplete and/or inaccurate. 
Secondary reporting can add respectability to inaccurate primary sources of data. 

personal records 


ber of different people contribute information to 
Because a large number o Peer the data in these 


(e.g. hospital, educational, work) over an extended period of time, 
records usually have low reliability. 


Reporting 


; ; lly to 
The remarks provided earlier about reporting the results of experiments apply equally 


research using documentary sources. 
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An Example 


: : , ee mmes for 
Several district health science institutes offer two year training progra 


health workers in a number of different categories. Each of the Cae iG ao, 
entered by people with a minimum of one year of secondary schoo eis weet 
Participation by both young and mature people is encouraged. Students who aa Lie... 
the first year of a programme receive "level one" certification. Stu en Seg 
successfully complete the second year receive "specialty certification. P 

certified at each level are in great demand in the National Health Service. enaeetiet 
relating to the numbers of students entering and successfully completing the programm 


is required by a national health manpower planning committee. 


year end 


Relevant available documents include registration data for several years, ; 
numbers 


class performance summaries (examination results, field experience assessments, 
of drop-outs), and individual student records (grades and biographic information). 


From the data available, tables may be prepared that describe the numbers of 
registrants, and the numbers of students successfully completing first and second years 
respectively for several successive cohorts of students. These tables should inc lude 
descriptions of the system in total and of each of the health science institutes and 


should satisfy the requests of the manpower planning comittee. 


There are, moreover, other questions that can be easily addressed. These include, 
for example: 


1. Which students have the better chance of successfully completing the first year, 
the second year? (male or female, young or mature students, single or married 
students) 


2. Are the entrance criteria and standards adequate? 
3. Are the schools operating at or near capacity? 


4. Are there trends in yearly registrations and drop-out rates by institute or in 
total? 


5. What are the grade distributions for the formal and the field experience parts of 
the programmes at each institute and in total? 


Other Example Problems 


1. What are the influences of existing professional bodies (e.g. national 
certification bodies) on professional training programmes? 


2. What are factors responsible for the migration of health manpower to more affluent 
countries? 


3. What are the costs associated with the training of non physician health workers in 
rural and urban settings? 


4, What is the current distribution of national health manpower? ll 


| Two published articles are provided as illustrations. The first uses published articles 
1n professional journals to summarize the situation of acute diarrhoea in the developing 
world. The author's analysis of the previously published information substantiates the 
present accepted positions concerning the prevalence of this problem, the care and treatment 
of those who are ill, and longer term effective preventive measures!2 (see Annex IV). 


In the second article, relationships between national incomes and health in the third 
world are examined and predictions are offered concerning future health status based on the 
observed trends. For this analysis, the author has used data from publications of the World 
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Bank and the World Health Organization He concl 

: udes by commenti : 
quantitative policy analysis (the analysis of national Phe arto the potential rols of 
income, gross national product and gross national expenditure) wore eo as cational 
national and international health programmes! 4 (see Annex V) . ormulation of 


CASE STUDIES 


A case study is a study of a "bounded system" (the ca 

whole or complete entity in itself. Examples could nee Pontes eer ees Pe of as 8 
rural village; a study of the consequences of introducing a recently 8 fc se pit 
into a rural village; and a study of a particular training programme for achasitin sais 
The primary purposes of a case study are to gain indepth knowledge and understandin . aie 
case and not necessarily generalization beyond the case. The goal of fon een. apni 
addressed with reference to experiences. gained in the study of many cases The 
distinctions between a case study and other research approaches relate to sackes ypc 
study the concern is with the case (a person, village, system, programme, organization 
etc.) and not with a’ population. Furthermore, the process of investigation is divected| at 
understanding and maintaining the wholeness of the case and not at its dissection into 
discrete variables or factors.* 


In a case 


Methodology 


Depending on his conceptualization of the problem the researcher is free to use any 
available research methodology from quantitative measurements and analysis to qualitative 
observations and descriptions. However, more often than not, field-based case studies 
involve an anthropological approach called ethnographic research. Using this approach, the 
researcher is usually a participant observer interested in impressions, descriptions and 
understanding as opposed to: the results of measurement. He usually works alone and stays 
"in the field" long enough to witness or participate in a complete cycle of events. The 
researcher establishes the validity of his impressions by verification with a variety of 
information sources (triangulation). In addition to functioning as a participant observer, 
he may use structured or unstructured interviews, administer surveys and draw information 
from documentary sources. However, qualitative observations are the most frequently used 
sources of data and can present the inexperienced researcher with major problems of 
interpretation and summary. WO 


In brief, the researcher examines a complex, dynamic, bounded social system. In the 
process of data gathering and interpretation he. looks for patterns, connexions, trends, 
etc., that sonmmapens with or suggest substantive modifications to his present views of the 
research problem. 4 


Criteria for the Selection of a Case Study 


1. When a problem arises that is specific to a given situation; 


2. When indepth information and understanding about people, social systems, and social 
phenomena are required; - 


3. When descriptions of the actual impacts of introducing a new programme are required; 


4. When planning a new programme for use with people of a particular social system OF 
culture; 


. : ther 
5. A case study can serve as the pilot phase for a more extensive study that uses 0 


research approaches. 


— 


ence should not be confused with 


* The “case study" approach to research in social scl : 
clinical or epidemiologic ''case reports’ or "case-controlled studies - 
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Advantages 


tems or related health manpower 
hat is compatible with the case 
e the only approach 
hat is essential 


l. In the development of community-based primary care sys 
training programmes, problems are usually of a scale Ct 
study perspective. For example, anthropological field work may b 
that will lead to an understanding of the village; an understanding C 
to the planning of rural primary health care. 


2. Because of its focus on people, the field-based case study is ideologically suited = 
research on community-based primary care systems. That is, in the cennbhpekgnny ae a 
systems people should have primacy. The system must not be imposed from abov ‘ 
should reflect the people's needs. Therefore, fieldwork is needed to find out about the 


people who are to be served. 


3. Case studies provide for direct study of social phenomena (the researcher sees what 
people are doing rather than what reports say they are doing). 


4. Reports of case studies have both cognitive and emotional appeal. Readers relate to the 
individual human events that are described. 


5. The case study approach has a natural appeal in that the researcher (and hence the 
reader) learns by experience rather than by experiment. 


7. Case studies of two or more similar situations will allow comparisons and can thus be 
used as a partial substitute for experimentation. 


Disadvantages 


1. Case studies tend to be viewed by administrators as too descriptive, too wordy, hard to 
evaluate, impressionistic, scholarly and too esoteric. 


2. Because this research process is lengthy, results are difficult to immediately relate to 


decision-making. This is particularly true with reference to policies that are changing 
rapidly. 


3. A case study may be difficult to sustain over the time period required to capture 
sufficient understanding of the case situation. 


4. Qualitative data are difficult to interpret and difficult to explain to health planners 
and administrators. 


5. Case or problem boundaries are difficult to define. 


6. There are few available competent field researchers. 


Reporting 


As with the research approaches described earlier, the researcher has an obligation to 
provide in his report an honest and clear description of his study's conceptualization and 
methodology in sufficient detail so as to permit replication. However, in addition, the 
story about the case should be told in sufficient detail and with sufficient skill so that 


teaders achieve understanding partly through cognitive processes and partly by experiencing 
the individual events. 


An Example 


a 


A district health department has proposed that village health workers be assigned 
to serve villages (from 100 to 400 families) remote from the district's centre of 
population. Prior to full scale implementation of this plan, it is proposed that a 


health worker be introduced in a selected village and that this process and its impacts 
be investigated. 
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In this case a researcher with fi 
eld experience mi bes | 
for several weeks prior to the assignment of the vache ae ee 
r to; 


l. gather information relevant to health service planning (e.g vivthen a - 
*&* emographics, 


mortality and morbidity information, th 
, e states of e : ‘ 
how and by whom care for the sick and injured is necbone rae ge a es 


2% determine the social structure of 
the villa 
ee lke ae oe h Be (e.g. how and by whom is the village 
8 ; at are the nature and extent of kinship relationships); 


3 7 i i i , 7 by . , 
bnitiate discussions with those in authority to determine their perceptions of the 
prevailing village health problems, introduce the district department's heal ’ 
service priorities, and negotiate terms, roles, and resnanetetttetis ¢ geet: 
proposed health worker that are acceptable to the village Pearce eter ip vat rhe 
department's objectives. . nt with the 


Once the assigned health worker establishes residence in the village, the 


researcher should visit frequently until he is confident that the new worker's situation 
is stable. In this interval the researcher may gather impressions from the village 
leaders, elders, and those other villagers he has identified as knowledgeable as well “ 
from the health worker. In addition, he may observe the health worker at work. Weekly 


or bi-weekly reports to the district health department can keep the planners abreast of 
the situation in the village as it develops, permit adjustments if and when necessary, 
and finally, provide a detailed written accounting of the pilot case. 


Other Example Problems 
1. How is training combined with the delivery of services in a given community? 


2. How does a community use the existing health services? 


3 How is learning about health encouraged in "the Asian cultural environment"? 
4. What is the impact of private practice in teaching health care institutions and 
their teachers? | 


ed How do currently operating health teams work? What are their functions? What are 
the hierarchical relationships of team members and how do these affect team 
functioning . 


Two published accounts of field based case studies are provided for illustration, The 
first is a description of primary health care in two rural villages in Saudi Arabia (see 
Annex VI). This report is included because its perspective is scientific, and the 
information it conveys is mainly quantitative. The research may be legitimately viewed as a 
case study because the main interest is with a bounded system (primary care in two villages? 
that is investigated to gain understanding of that system and not for the purpose 0 


generalization. 


Class and Health Culture in India by 


The second example, taken from the book Poverty, ; Segal 
D. Banerji illustrates the conventional anthropological approach to field-based cas idy 
major concern and its 


and reporting. It includes an introduction to the book's 
pu tudy (the case of Suryakanta Mukherjee, 


lization 1-3) and one’particular case s 
wlsige | ener A PP e e social structure 


pp-62-66) that the author uses Co establish and describe a picture of th 
of a rural West Benghali village.}/ 


PROMOTING THE CREDIBILITY OF SOCIAL AND BEHAVIOURAL SCIENCE RESEARCH 


tend ial research 
If health planners and administrators are to incorporate the results of soci 


in decision-making: 


ts 
l. This research should focus directly at the real problems confronted in the developmen 


of effective community based primary care systems; 
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2. The research should be properly conceptualized and executed; 


ific needs of health 
3. In writing his report, the researcher must keep in mind the spec 
planners and administrators. For example: 
ini useful 
a) Discipline-related jargon should not intervene between administrators and 
research results; 


b) Research results should reach the appropriate administrators quickly; 


c) Results should be described and explained with reference to specific problems. 


4. Health planners and administrators must be sensitized (through educational efforts) to: 


a) the appropriate uses of social and behavioural science research approaches; 


b) the past successes and hence the future usefulness of these research approaches. 


5. When possible, health planners and administrators should be involved in the planning, 
execution, and reporting of the research related to the problems described in item (1). 


TRAINING 
Goals and Objectives 


The ultimate success of a programme in promoting the appropriate and effective use of 
behavioural and social science research requires: 


l. The training of medical and other health personnel in the elements of applied social 
research. The goals of this training will be to provide personnel with an appreciation 
of the use of, or in some cases capable of using, a variety of social research 
approaches in the solution of problems associated with the development of community- 
based primary care systems. 


2. The orientation of health planners and administrators to be effective consumers of the 
results of applied social research. The goals of this orientation will be to make 
planners and administrators familiar with the variety of social research approaches 
available, capable of making reasonable and informed requests of the researchers and 
also making informed assessments of research proposals submitted by researchers, capable 
of participating in the process of planning and possibly executing this research in 
collaboration with researchers, and capable as administrators of translating the 
research results into effective actions in the development of community based primary 
Care systems. 


3. The orientation and training of social and behavioural scientists for active and useful 
roles in health service research and HMD research. 


The training goals for the researchers and health planners and administrators probably 
have only limited areas of overlap. An example of a common goal is the need to sensitize 
each group with the other's roles, responsibilities and needs. Learning objectives related 
to common goals could be addressed through joint learning experiences. However, it is 
anticipated that, in the main, two separate levels of training will be needed with each 
addressing its own set of learning objectives. 


Research Training Objectives 
pent Sl SL MAA AAR Ad 


Given a problem related to the development of community based primary health care, the 
participant will: 


1. Select an appropriate research approach and justify his selection by demonstrating the 


match between the problem as conceptualized and the approach selected; 
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2. Propose an appropriate research design and also d 
aa . ; . esc ; 
The participant will justify his design with Fibe the methodologies to be used. 


: referen 
conceptualized. ce to 


the original problem as 


3. Estimate the resources (people, technolo 
gy and fina 
proposed research; nce) and time required to execute the 


4. Demonstrate that the research proposal will sati 
= isfy the need 
administrator. eds of the health planner or 


Orientation Objectives 


Given a health problem with implications for health manpower development, defined with 
reference to a particular context (geographical, political, social) ‘ 


ee : ; “ape and requirin 
administrative action; the participant will: . . 


1. Redefine the problem in terms of a series of specific research problems; 


2. Rank order the research problems in order of their relative importance in informing 
decision-making; 


3. Provide a schedule for the planning, executing and reporting of the research; 


4. Assign resources (people, technology and finance) assuming strictly limited amounts of 
each; 


5. Describe the nature and extent of his own involvement and the responsibilities of the 
researcher(s) ; 


6. Provide a copy of his instructions to the researcher(s). 
In addition the participant will: 


7. Provide a detailed evaluation of a research proposal requesting permission and funding 
for the project related to the development of a community-based primary care system. 
This evaluation should consider: 


a) The value of this project to planning and administrative needs; 
b) The conceptualization of the project as a research problem; 
c) The appropriateness of the research approach and methodology; 
d) An assessment of the resource estimates. 

PROGRAMME PLANNING 


As an initial step it is proposed that a group responsible for programme planning ws 
implementation be established (at an appropriate level and location ~ WHO/HMD Geneva 
SEARO). 


Programme planning should proceed with reference to the following assumptions: 


. i ial not 
1. Training (orientation) experiences should be problem-based and experienti 


discipline-based and didactic; 


: ; d research 
2. That the training goals are to produce applied social vngebeachihnerfe orimary 
administrators useful to and committed to the development of commu y 


care systems; 


; . : ini orientation of 
3. That the achievement of these goals will require systematic training/ 


participants over extended periods of time. 
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A training/orientation programme might include, for example, on-the-job or internship 
involvement with research and/or research management with supervision by approprrAte 
personnel. The level of participant responsibility and involvement would increase 4S 
training/orientation progresses. In addition, it could involve periodic participant 
meetings or workshops for purposes of focussing, maintaining continuity, considering 
participant problems, group support, and the consideration of progress reports and case 
materials. 


The resources required would include trainers and resource people selected from the pool 
of available academic researchers and health administrators. These people should be 
committed to the development of community-based primary care systems as the appropriate path 
to HFA/2000, and should have research and/or administrative views consistent with those 
expressed at the Inter- regional Consultation summarized in this document. It is assumed 
that it will be possible to orient the trainers and resource people to the programmes’ goals 
and learning approaches. Needed also would be illustrative materials from journals, 
reports, and books. It is suggested that the development of appropriate problem-based case 
materials be encouraged. Finally, a wide range of available internship positions would be 
needed. 


EE 
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GLOSSARY 


1. Research approach: the generic term, e.g 


. e ; -. - 
case study. » ©xperimentation, quasi- 


experimentation, 


2. Research design: the umique adaptation of a research a roach 
Situation, e.g. the post-test only, and pre- and post-test designs Atte: sare s pa mgr 
in pp. 276. 


3. eer ;' 
Research methodologies: the measurement, observation, 
etc., procedures used in executing the research. 


calculation, interpretation, 
4. Variable: any representation of a trait or characteristic (of a person rou 

etc.) that is capable of assuming different values. » SFaup, systen, 

5. Matching: in an experimental design when random assignment of subjects to groups is not 


possible, subjects may be assigned so that group equivalence with respect to certain key 
variables is assured. For example, matching on the variable " a 


: q sex would assure equal 
proportions of males and females in each group. q 


6. Cohort: a group of people having a statistical factor in common (e.g. membership in a 
, particular training class). 


7. Inferential statistics: the branch of statistics that treats sample data for the 
purposes of generalization. 


8. Secondary analysis: the analysis of data from documentary sources. 


9. Data collection: quantitative (measurement processes) ; qualitative (observations, 
interviews, anecdotes, minutes). 


10. HFA/2000: World Health Organization declaration from 1978 Alma Ata Conference "Health 
for all by the year 2000". 


ll. HMD: health manpower development. 
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THE BURLINGTON RANDOMIZED TRIAL OF THE NURSE PRACTITIONER 


Wacrer ©. Sprrzer, M.D., M.H.A., M.P.H., Davip L. Sackett, M.D., M.Sc. Epip., 
Joux C. Siprey, M.D., F.R.C.P. (C), M.R.C.P., Rosin S. Roserts, M. Tecu., Michaer Gent, M.Sc., 
Dorotuy J. Kerciy, R.N., Px#.D., Brenpa C. Hackett, B.A., AnD AnTHONy Orynicn, C.A. 


In Collaboration with W. I. Hay, M.B., B.S., G. Lefroy, R.N., G. Sweeny, M.D., C.M., I. Vandervlist, R.N., 


HS. Nielsen. M.D.. E. V. MacKrell, M.B., N. Prowse, R.N., A. Brame, R.N., E. Fedor, R.N., B.A., 
and K. Wright, B.N. 


Abstract From July, 1971, to July, 1972, in a large sub- 
urban Ontario practice of two family physicians, a ran- 
domized controlled trial was conducted to assess the 
effects of substituting nurse practitioners for physicians 
in primary-care practice. 

Before and after the trial, the health status of patients 
who received conventional care from family physicians 
was compared with the status of those who received 
care mainly from nurse practitioners. Both groups of 
patients had a similar mortality experience, and no dif- 


HE concept of using nonphysicians to provide pri- 
mary health service has seldom been accompanied 


by quantitative clinical evidence that this new form of 


From the schools of Medicine and Nursing. McMaster University (address 
reprint requests to Dr. Spitzer of the Department of Clinical Epidemiology 
and Biostatistics, MeMaster ( niversity, 1200 Main St. West. Hamilton, On- 
taro, Canada. LSS 49). 

Supported by 4 grant (DM34) trom the Ontano Health Resources Dey el- 
opment Plan. Ministry of Health of Ontario, and a National Health Grant 
(6021-66) of Health and Welfare Canada (the Latter for the quality-of-care 
compenent). 


ferences were found in physical functional capacity, so- 
cial function or emotional function. The quality of care 
rendered to the two groups seemed similar, as assessed 
by a quantitative “indicator-condition” approach. 
Satisfaction was high among both patients and pro- 
fessional personnel. Although cost effective from so- 
ciety’s point of view, the new method of primary care 
was not financially profitable to doctors because of cur- 
rent restrictions on reimbursement for the nurse-prac- 
titioner services. (N Engl J Med 290:251-256, 1974) 


patient care is both safe and effective. Our interest in 
testing the primary-care performance of nurse practi- 
tioners was stimulated by three distinctive features 
of the medical situation in Ontario: the delivery of 
primary health care is still oriented toward family 
physicians, who constitute 48 per cent of all registered 
physicians in the Province; the total number of family 
physicians is adequate (with an average ratio of Ist 723 
per total population), but they are unevenly distribut- 
ed so that many rural and small-town family physi- 
clans are overburdened'; and asurplus of well trained, 


HMD/ 83.3 


Page 


21 


HMD/ 83.3 
Page 22 


252 


experienced nurses has existed in the Province for 
several years.*** 

An opportunity to perform the desired test was pre- 
seried in 1970, when two family physicians in Burling- 
ton, a middle-class suburban town of 85,000 just east of 
Hamilton, approached the Faculty of Medicine of 
McMaster University for possible help in introducing 
this innovation into their practice. For at least two 
years, their practice had been “saturated” — accepting 
no new patients or families because of inability to man- 
age an increased case load. The physicians believed 
that their office nurses, with appropriate additional 
training, could assume a substantial portion of the 
responsibilities for primary care. 

With this opportunity and with the offered co-oper- 
ation of these and other participants, a collaborative 
group was formed, and two complementary random- 
ized trials were designed. In one of these trials, reported 
elsewhere,*> the major emphasis was on the way in 
which physicians and nurses were affected by the new 
form of practice. In the second trial, which is reported 
here, the principal concerns were with the effects on pa- 
tients and on the practice itself. 


PARTICIPATING PERSONNEL AND BACKGROUND 


The two family practices under study had previously had no af- 
filiation with a university or other institution. Patients in each prac- 
tice were free to seek any desired source of primary care, and the 
costs of care, regardless of source, were completely covered by uni- 
versal health insurance in Ontario. 

One of the family physicians had received his medical degree in 
1953 from the University of Durham and had practiced in Burling- 
ton for nine years; the other physician had graduated from McGill 
University in 1954 and had been practicing in Burlington for 14 
years. One nurse had received her R.N. diploma in 1959, and the 
other nurse in 1948. 

Before the study began, the nurses attended a special training pro- 
gram® conducted by the schools of nursing and medicine at McMas- 
ter University. The emphasis of this program is on decision making 
and clinical judgment, rather than on procedural skills. The gradu- 
ating nurse practitioners are qualified to become not physicians’ as- 
sistants, but co-practitioners, sharing the family physician’s responsi- 
bility for continuing care of patients. The nurse practitioner learns to 
evaluate each patient’s presenting problems, and to choose from 
three possible courses of action: providing specific treatment; pro- 
viding reassurance alone, without specific treatment; or referring the 
patient to the associated family physician, to another clinician or to 
an appropriate service agency. 


METHODS 


The research contained at least three major methodologic chal- 
lenges: the development of appropriate technics for assessing the 
outcome as direct effects on the patients’ state of health; the develop- 
ment of quantitative methods for evaluating the process of medical 
care and the dynamics of an experimental practice; and the complex 
administrative logistics of preparing the patients, training interview- 
ers and other data gatherers, maintaining the protocol and co-ordi- 
nating data reduction and analysis. 

In this paper, we report the general design, logistics, and data of 
the trial, together with a summary of the results obtained for pa- 
tients’ health status and quality of care. 


The Investigated Patients 


Because many clinical problems in primary care involve an entire 
family, families were chosen as the unit for randomization. A “fami- 
ly,” which was defined as a person or group sharing a common pro- 
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vincial health-insurance number, typically encompasses a breadwin- 
ner, the spouse, and the dependent children. From the business rec- 
ords or clinical records of all families using the two practices, 1801 
families, representing approximately 4850 people, were enumerated. 

To be eligible for the trial, a family had to be established as having 
an ongoing medical relation with the practices. This relation was 
demonstrated if one of the family members had cither made contact 
with one of the practices in the prior 18-month period or (during 
later interviews) identified the doctor as the family physician. The 
eligible people comprised 1598 families, containing 4325 members. 


Randomization 


Because a case load half that of a family physician’s was consid- 
ered manageable for a nurse practitioner, the eligible families were 
stratified by practice of origin, and randomly allocated in a ratio of 
2:1. They formed a randomized conventional group, assigned to con- 
tinuing primary clinical services from a family physician and a con- 
ventional nurse, and a randomized nurse-practitioner group, whose 
first-contact primary Clinical services were to be provided by a nurse 
practitioner. The resulting conventional group contained 1058 fami- 
lies (2796 members) equally divided between the two doctors, and 
the nurse-practitioner group comprised 540 families (1529 mem- 
bers), equally divided between the two nurse practitioners. 

After these assignments were completed, adult patients were sent 
a letter explaining their clinical allocation and the plans of the study. 
For subsequent medical care, after July 1, 1971, patients in the 
nurse-practitioner group were asked to make appointments with the 
named nurse, instead of with their customary doctor. All the families 
were given the opportunity to refuse their assignment and opt out of 
the trial. 

Figure | shows the timing of these procedures and of subsequent 
events in the performance of the study. 


Selection of Patients for Surveys before and at the End of the 
Experimental Period 


After the letters were distributed, a household survey was per- 
formed in a sample of the enumerated families, the interview cohort. 
This cohort received interviews to acquire the data needed for 
“paired comparisons” of change in health status and medical utiliza- 
tion. The patients for the interview cohort were chosen randomly as 
a single member from eligible families participating in the trial and 
living within 32 km of the doctor’s office. To ensure sufficient num- 
bers of children in the surveys, one third of the families were ran- 
domly designated as “child priority.’” The member for the interview 
cohort was then randomly chosen from any children contained in 
these families or otherwise, from the adults. 

The resulting cohort that was successfully interviewed in both 
years included 817 patients, with 296 in the experimental group and 
521 in the conventional control group. The refusal rates in the sur- 
veys were 11 per cent in 1971 and 5 per cent in 1972. 


Data Obtained before the Experimental Period 


Measurements on patients. Trained houychold interviewers adminis- 
tered pretested standardized questionnaires* to the interview cohort 
to obtain demographic information, information on prior use of clin- 
ical services and data satisfaction with health care. Special question- 
naire instruments, described elsewhere, were used for assessing 
health status in physical function. a 

Clinician actwities. Time-and-motion studies of the physicians and 
conventional nurses were used to indicate the mixture of clinical and 
nonclinical activities in a representative week of family practice. 

Activities of the practice: A “day-sheet journal’ was maintained for 
all clinical activities in the practices. For each visit or encounter with 
any medical or nursing practitioner, a separate entry was made in 


*For 228 pages of questionnaire instruments used in this project order 
NAPS Document 02178 from National Auxihary Publications Service, c/o 
Microfiche Publications, 305 E. 46th St. New York, N.Y. 10017: remitung 
$1.50 for microfiche-copy reproduction or $34.70 tor photocopies. Checks or 
money orders should be made payable to Microfiche Publications 
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Figure 1. Schedule of Time and Events during Implementation of the Trial. 


the journal, and included the following information: the patient’s 
identification number; the date; the type of service; whether the pa- 
tient was new to the practice; the presenting complaint (or com- 
plaints) or problems; diagnosis (or diagnoses), procedures (if any); 
the principal professional person who provided service at the partic- 
ular visit; whether the doctor was involved in the visit or whether the 
nurse practitioner had provided the service alone without consulta- 
tion; whether the patient was referred outside the practice; whether 
a prescription had been given to the patient; and the dollar value of 
service according to the provincial medical association’s schedule of 
fees.* 

In the eight-week base-line period, there were 2991 encounters 
for the groups who became the conventional and nurse-practitioner 
combined trial practice. 


‘Data Obtained during the Experimental Period 


Measurements on patients: In addition to the cited data on health 
status, “dropouts” were identified, and all deaths were recorded. 

Clinician activities. The quality of care in “clinical judgment” used 
by the co-practitioners was assessed with two quantitative methods. 
One of these was based on identifying and assessing the manner in 
which the practitioners managed a series of 10 indicator conditions. 
As suggested in Kessner’s concept of “tracers,*" an indicator condi- 
tion is a distinct clinical entity (such as a discase, symptom, state or 
injury) occurring frequently in primary care, with an outcome that 
can be affected favorably or adversely by the choice of treatment. 
The second method for assessing the quality of medical care was to 
evaluate the manner in which 13 common drugs were prescribed. 
Explicit criteria for adequacy in the management of indicator condi- 
tions and prescription of drugs were established before the trial by a 
peer group of nonuniversity family physicians practicing in the same 
area. The selected conditions and drugs were not known to the Bur- 
lington co-practitioners during the trial. These approaches received 
_a preliminary report, with details presented elsewhere.” 

Practice actwities. All clinical activities were monitored throughout 
the entire experimental period and recorded in the day-sheet jour- 


*A service ordinarily given by a physician, but now given by an unsuper- 
vised nurse practitioner, was fated at the same dollar value.as a doctor's ser- 
vice for purposes of financial analysis, but could not be reimbursed by gov- 
ernmental health insurance. 


nal. During the experimental year, data were obtained for 21,085 en- 
counters. 


Data Obtained at the End of the Experimental Period 


Measurements on patients. The household surveys of health status 
were repeated, with added questions on social and emotional func- 
tion. 


Clinician activities. The previous studies of clinical activities were 
repeated during the eight-week comparison period, one year after 
base line. Quality-of-care measurements were continued to the end 
of the trial. 

Practice activities. The day-sheet journal surveillance was continued 
for a year after the trial to ascertain longer-term effects of this meth- 
od of practice on profitability and cost effectiveness. 


RESULTS 
Base-line Survey and Encounter Data 


Measurements on patients (Fig. 2). As determined in the 
1971 household survey, the patients in the convention- 
al and nurse-practitioner groups had highly similar 
values for physical function, ability to carry out usual 
daily activities and freedom from bed disability. The 
base-line health status of the two groups of patients 
showed only minor differences that were not statisti- 
cally significant (at an a level of 0.05). 

Clinician activities. Physicians had been involved in 86 
per cent of all visits to the practices, and the conven- 


tional nurses alone had dealt with the remaining 14 per 
cent of encounters. 


Results during the Experimental Period 

Of the 1598 families eligible for the trial, only seven 
families (two from the conventional group and five 
from the nurse-practitioner group) refused their assign- 
ments. Two families in the conventional group Pre 
ferred care by nurse practitioners, two families in the 
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own services had been reduced enough to allow new 
families to be accepted in the previously “saturated 
practices. After one year, the practices had grown to 
1952 active families, a net increase of 22 per cent. 


Results at the End of the Experimental Period 


Clinical outcomes. As shown in Figure 2, the levels of 
physical status remained closely similar in the patients 
in the two groups. In measurements performed at the 
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Figure 2. Physical Status of Patients in Surveys during Base-line 
(71) and Comparison ('72) Periods. 


These results are based on 521 subjects in the conventional 
(RC) group and 296 in the nurse-practitioner (RNP) group who 
were assessed in both 1971 and 1972. 


nurse-practitioner group opposed the new concept, 
and three others had had a member under care by a 
doctor for a long-term problem. 

Measurements on patients. During the year 0.9 per cent 
of families in the conventional and 0.7 per cent in the 
nurse-practitioner group left the practice because of 
dissatisfaction. 

Clinical activities (Fig. 3). In 392 episodes of care for 
the 10 indicator conditions, the management was rated 
as adequate for 66 per cent of episodes in the conven- 
tional and for 69 per cent in the nurse-practitioner 
group. In 510 prescriptions similarly analyzed, an ade- 
quate rating was given to 75 per cent in the conven- 
tional group, and to 71 per cent in the nurse-practi- 
tioner group.* 

Practice actwities. The doctors in the conventional 
group continued to be involved in about 86 per cent of 
all patient visits throughout the trial. For visits of pa- 
tents in the nurse-practitioner group, the doctors were 
involved in 45 per cent of visits during the first eight 
weeks. This proportion fell to 28 per cent by the 20th 
week, and rose from the 21st to the 44th week, when 
many new families were being seen for the first time. 
Starting with the final eight weeks of the trial the pro- 
portion of patient nurse-practitioner visits involving 
the doctor stabilized at 33 per cent. Subsequent follow- 
up study confirms that nurse practitioners handle two 
thirds of episodes without consulting a physician. 

As noted from our enumerations and household in- 
terviews before the trial, the two original practices had 
provided care for an active roster of 1598 families who 
had an ongoing relation to the practitioners. Within 
eight weeks after the new form of practice was intro- 
duced, the physicians found that the demands on their 


“The differences are not Statistically significant at an a level of 0.05. Since 
demonstration of “no difference” or “no deterioration” is of greater concern 
in an experiment where we have compared a new form of Practice with a 
standard practice, we also calculated A levels. Given the results. the proba- 
bilities of real deterioration of at least 5 per cent in physical function went 
from 0.02 to 0.01. The probabilities of real deterioration of at least 10 per 
cent were 0.004 for indicator conditions and 0.08 for drugs. 


end of the trial in the 1972 survey, the index of emo- 
tional function was 58.3 per cent in 521 patients in the 
conventional and 57.9 per cent in 296 in the nurse-prac- 
titioner group. Corresponding values for the index of 
social function were 83.2 per cent and 83.9 per cent.” 

During the experimental period, there were 22 
deaths — 18 in the conventional group and four in the 
nurse-practitioner group. The difference in crude 
death rates was not clinically or statistically significant. 

In the follow-up survey, 97 per cent of patients in the 
conventional and 96 per cent in the nurse-practitioner 
group were found to be satisfied with health services re- 
ceived during the experimental period. 

Clinician actwities. Figure 4 shows the financial perfor- 
mance of the practices, as compared with the base-line- 
period level of 100 per cent. The drop of 5 per cent in 
actual gross practice revenue is explained by the ab- 
sence of billing for clinical services provided by nurse 
practitioners. If reimbursement for these services had 
been permissible, the increased volume of services with 
a 22 per cent increase in number of families under care 
would have produced a 9 per cent rise in income. Ac- 
cording to the dollar-weighting procedure for fees, ser- 
vices rendered by each nurse practitioner during the 
trial year were worth approximately $16,000. of which 
almost 50 per cent was for unsupervised service. 

Together with other financial studies, these data in- 
dicate that the economic advantage that society attains 
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Figure 3. Percentage of Episodes of Care Rated as Adequate. 
The denominators for these percentages were a total of 392 ep- 
isodes for indicator conditions — 225 in the conventional (RC; 
and 167 in the nurse-practitioner (RNP) group — and 510 epi- 
sodes for drugs (284 in the RC and 226 in the RNP group). 
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Figure 4. Performance of Practices. 


The activities during the base-line period were given a value of 
100 per cent for each of the three categories of performance 
assessed. 


from the primary-care nurse practitioner is accompa- 
nied, under current Ontario regulations that prohibit 
billing for unsupervised nurse-practitioner services, by 
the physician's loss in net income of nearly $12,000 per 
year. 

Practice activities (follow-up observations). One year 
after the experimental period had ended, the practi- 
tioners reported that they were at a new plateau of 
“saturation.” As of June 30, 1973, 2256 registered fam- 
ilies were under ongoing care, a 41 per cent increase 
from the 1598 families two years earlier. 


DiIscuUSSION 


In recent years, a few health-care trials, some with an 
element of randomization, have been reported.'*"'® 
The current research adds further evidence that inno- 
vations in health care can be assessed with randomized 

‘controlled trials. 

Neither the concept of the nurse practitioner nor the 
evaluation of this new concept is new. “Outpost nurs- 
es” have established an enviable record of clinical ac- 
complishment in isolated areas in the Canadian North 
and Maritime provinces.'* In the United States, Silver 
and his colleagues'*'” pioneered many current con- 
cepts of the nurse practitioner's role in pediatrics. Yan- 
kauer et al.2"-2' dealt with other issues of education and 
the efficient deployment of nurses in pediatric am- 
bulatory settings. Other investigators***" have de- 
scribed the use of nurse practitioners in adult primary 
care. . 

Introduction of the nurse practitioner has often been 
accompanied by evaluative research, including de- 
scriptive studies,'*"" surveys”? and assessment of proc- 
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er) ect,” assumed by the collaborating 
physicians and nurses, was almost entirely divorced 
from the specially trained interviewers, abstractors and 
observers who acted as “data gatherers”; all the data, 
including base-line data, were gathered purposefully 
and prospectively; both traditional and new health- 
care measurements were incorporated into an experi- 
ment patterned after a clinical trial, with the attention 
directed primarily at changes in health status; the 
study was carried out in previously saturated practices 
that were non-university and non-institutional; and, 
finally, a unique characteristic of the setting was that 
patients, if dissatisfied, had complete freedom to seek 
care from another source. Not only were several family 
physicians in the community accepting new families, 
but Canadian universal insurance covers costs com- 
pletely regardless of the chosen source of care. 

The results demonstrate that a nurse practitioner 
can provide first-contact primary clinical care as safely 
and effectively, with as much satisfaction to patients, as 
a family physician. The successful ability of the nurse 
practitioners to function alone in 67 per cent of all pa- 
tient visits and without demonstrable detriment to the 
patients has particularly important implications in 
planning of health-care delivery for regions where fam- 
ily physicians are in short supply. 

The increased number of patients who could be 
added to the previously saturated practices is probably 


due mainly to the case load carried by the nurse practi- 
tioners, but cannot be attributed to their activities 
alone. The physicians involved in this trial believe that 
their own work became more efficient since they were 
forced to develop the rigor and clarity of thought need- 
ed to communicate with their co-practitioners. 

The decreased gross revenue of the practices is at- 
tributable to current regulations that do not permit the 
governmental health-insurance plan to pay for services 
rendered by an unsupervised nurse. Since nurse practi- 
tioners can provide a major increase in total quantity 
of clinical service, without a reduction in quality, a 
suitable adjustment of these financial regulations 
would make the innovation more attractive to physi- 
cians, while allowing society to obtain the additional 
benefits in care at a net cost that is still less than that of 
conventional approaches. Several medical practition- 
ers and officials of the provincial health-insurance plan 
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are now collaborating in an effort to develop appropri- 
ate new formulas for these financial arrangements. 


We are indebted to Dr. John R. Evans, formerly dean of the Facul- 
ty af Medicine of McMaster University (now president of the Uni- 
versity of Toronto), for encouragement and support during the pre- 
liminary phase of this study (his leadership made possible the envi- 
ronment and the resources required for large-scale health-care trials 
in the Hamilton region) and to Dr. Alvan R. Feinstein, of Yale Uni- 
versity, for counsel and critical review during preparation of the 
manuscript, 
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An evaluation of a rehabilitation workshop 
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AND D. GRIFFITHS 


Department of Psychology, Whitchurch Hospital, Cardiff 


Summary 


Staff awareness of the steps involved in rehabilita- 
tion was assessed before and after a multidisciplinary 
workshop concerned with the aims, methods and 

. principles of rehabilitation in psychiatry. Results 
were compared with similar assessments derived from 
a matched control group which was not exposed to 
any educational programme. The data suggest severe 
limitations in staff performance on the rehabilitation 
problem solving task which was used. Performance 
was not improved by the workshop, and the limit- 
ations of staff opinion as measures of the educational 
value of the workshop were clearly demonstrated. 
These results are consistent with other findings, and 
demonstrate the need to evaluate educational 
programmes provided in the Health Services. 


Key words: *REHABILITATION; PsyYCHIATRY;*educ; 
EVALUATION STUDIES; INSERVICE TRAINING; WALES 


Introduction 


The aim of this investigation was to evaluate a multi- 
disciplinary workshop which was provided to 
acquaint staff with the principles, methods and 
problems of rehabilitation in a psychiatric setting. 
The workshop had been organized on one previous 
prcasion, and involved considerable expenditure of 
time, effort and money. In view of the effort and 
resources involved—and the intention to repeat the 
Correspondence: Dr David Griffiths, Dept of Psych- 


ology, Whitchurch Hospital, South Glamorgan A.H.A.AT) 
Cardiff CF4 7XB. 


0308-0110 80 0100-0036802-00 « 1980 Medical Education 


36 


workshop at regular intervals—it was decided to 
attempt an objective evaluation of its contribution to 
staff expertise and performance. An _ objective 
evaluation also seemed important in view of previous 
demonstrations that workshops, and_ in-service 
courses generally, cannot be assumed to produce 
changes in staff behaviour which justify the effort 
and cost (Klaber, 1969; Quilitch, 1975). 

The investigation undertaken was also concerned 
with different measures of outcome. The most 
commonly used index of the value of inservice 
courses is staff opinion. Quilitch’s (1975) results 
indicated, however, that staff satisfaction is not an 
accurate guide to the success of a workshop in 
promoting behavioural change within an institution. 
It was therefore decided to compare staff ratings of 
the success of the present workshop with other 
measures of change, and to establish whether there 
was any relationship between satisfaction and 
changes in behaviour. 


The workshop 


This was organized over a period of 14 days. and was 
divided into three sessions, each lasting for approx- 
imately three hours. The first was concerned with 
assessment and goal setting: the second with treat- 
ment and management, and the third with the 
aftercare of the patient in the community. The 
workshop involved a combination of talks, dem- 
onstrations, small and large group discussions. The 
teachers included two psychiatrists, two psycho- 
logists, a social worker. an occupational therapist 
and an industrial manager. Chairpersons and 
reporters for the discussicns were elected from 
amonuyst the multidisciplinary group of twenty 
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4 rehabilitation workshop 


individuals (doctors, nurses, social workers, Occupa- 
tional therapists, industrial supervisors, psycho- 
logists) who attended the workshop. The aims, 
methods and problems of rehabilitation in psychiatry 
were stressed throughout the workshop. 


Assessments, design and subjects 


Assessments 


The following assessment was used as a dependent 
variable. Each individual was shown the following 
account of a hypothetical case. 


‘The patient is a 26-year-old male who has been 
admitted because of his parents’ complaints of 
aggressive outbursts at home. He has always 
lived with his parents (who are in their late 50's) 
but their tolerance of him has been increasingly 
weakened by his failure to hold a job for more 
than a few days, his rudeness to them and his 
apparent loss of interest in life. Though he has 
been abusive to his parents over about 6 months, 
he has never been physically violent. 

Further assessment indicates that he was 
employed as an apprenuce engineer until the age 
of 20 but since this time has had numerous jobs 
(mostly unskilled) and long periods of un- 
employment. He has also gradually lost contact 
with his friends. 

On admission, he was presentable in appear- 
ance and deferential !n manner. Though he 
always replies when addressed by others, he is 
otherwise solitary and withdrawn. His main 
complaints have been about feelinys of fatigue 
and irritability, and a:so his failure to keep 
jobs. He is contented to sit on the ward and read. 
and is not interested in any ward activities’. 


The protlem posed for each staff member was as 
follows: 


“If you were responsivle for the care and re- 
habilitation of this person. what steps would you 
take to help him? {n giving your answer. con- 
sider a long-term programme of rehabilitation 
—do not limit yourself to immediate steps or 
short-term treatment’. 


The response was tape recorded and subsequently 
seansceibed for rating by assessors. 

The adequacy of each response was rated by using 
a standard rating system. The system is based on the 
assumption that a_ rehabilitation programme 
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involves five basic and necessary steps, (a) prelim- 
inary assessment, (b) formulation of provisional 
goals for the patient, (c) treatment and management 
(medical, social and psychological), (d) monitoring 
of progress and change and (e) aftercare (in the 
community, if appropriate). Each of these steps is 
represented in the rating system, and is allocated 
equal weight. The rating system is available on 
request to the last author. 

Staff response was assessed via two sets of ratings. 
First, an overall rating of adequacy on a 15 point 
scale. Second, five separate ratings (each on a 3 point 
scale) involving each of the five major steps of a 
rehabilitation programme. On both sets of scores, a 
poor or inadequate response was indicated by a low 
numerical score. 

The same hypothetical case was used for initial and 
follow-up assessments. Though repetition introduced 
the possibility of practice effects at follow-up. such 
effects could be estimated by repeated ratings derived 
from a control group who did not attend the 
workshop. 

Staff were also required to complete the rating 
scales provided in the appendix. These were intended 
to measure various aspects of satisfaction with the 
workshop, and were administered at the end of the 
last session. 


Design 


Staff who attended the workshop were assessed 
beforehand. and again after a period of approx- 
imately 2 months. The workshop was held within 2 
weeks of the first assessment. 

In addition, half of the staff attending the work- 
shop were assessed within 10 days of the workshop’s’ 
termination, and again at the 2-month follow-up. 
This was to assess whether an examination of their 
performance soon after the teaching sessions would 
produce an improvement in their response to the 
problem case. If this had occurred, their response to 
the hypothetical case would be expected to be more 
adequate at the final assessment. 

A control group of staff, matched with the 
experimental group for sex, professional group and 
age (within 5 years) were also assessed on two 
occasions with an intervening intervai of approx- 
imately 2 months. They did not attend the workshop. 


Subjects 


From a total of twenty staff who attended the 
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workshop. complete data were available for fifteen. 
Eight of these were assessed on three occasions, and 
the remaining seven on two occasions. The control 
group consisted of ten staff. 

In the experimental group, there were seven 
nurses, four doctors, two psychologists, one admin- 
istrator and one occupational therapy aide; in the 
control group there were five nurses, two doctors, 
one psychologist, one administrator and one 
occupational therapy aide. Tnere were six males and 
nine females in the experimental group: three maies 
and seven females in the control group. 


Resuits 


The following are the questions posed during the 
investigation and also the data gathered to provide 
answers: 
ti) How loag was the follow-up period? The 
period between the initial and follow-up 
assessment was on average 8:6 weeks 
( —3-5) for the experimental group and 9-2 
weeks ( — 2-4) for the controls. The difference 
\was not significant (Mann Whitney U=57 : 
ns= 10 and 15). The 8 experimental subjects 
assessed soon after the workshop were seen, 
on average. 2:75 weeks after the initial 
assessment 
Gi) How reliable were the ratings of staff response 
to the hypothetical problem? Every response 
was rated independently by three assessors 
(clinical psychologists). Estimates of reli- 
ability were calculated in two ways. 


First. by calculating Spearman rho rank order 
correlations from the ratings. Analyses were con- 
ducted on the 15 point general ratings. Correlations 
were calculated separately for initial and follow-up 
assessments. and also for the experimental and 
control groups. The three correlations (between the 
three assessors) for the initial ratings within the 
experimental group were 0°65 (P< :01), 0:78 (P <-01) 
and 0-49 (not significant): at follow-up the cor- 
relations were 0°86 (P < 001). 0:86 (P < -001) and 
082 (P<-001). For the control groups the corres- 
ponding correlations were 0°81 (P <:05), 0°69 
(P<-05) and 0°64 (P<-05) for initial ratings; the 
correlations were 0°44, 0°38 and 0°61 at follow-up. 
none of which were significant. With the exception 
of the final assessments of the control subjects, there 
is consistent agreement between the assessors. 

Second. degree of agreement between assessors 
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was also calculated by comparing absolute ratings. 
For this purpose, the ratings on the 15 point scale 
were divided into three bands (1-5, 6-10 and 11-15). 
A disagreement was recorded when ratings fell into 
different bands. Out of a possible forty-five dis- 
agreements for the environmental group (fifteen 
ratings and three judges), there were fourteen 
disagreements amongst the initial ratings and five at 
the follow-up. The number of disagreements for the 
controls, out of a total number possible of thirty 
(ten ratings. three judges). were two at the initial 
assessment and five at the follow-up. 

Taken together these results suggest that the ratings 
are reliable and generally consistent. For further 
analyses one score was derived from each response, 


this being the average of the three separate (but 
correlated) ratings. 


(iii) How adequate were staff responses to the set 
problem, and were the responses of the 
experimental group improved by the work- 
shop? The responses were again analysed in 
two ways. First, the subject's mean score 
(from three assessors) on the 15 point 
general rating. Second, the sum of scores 
from the five sections in the rating system 
(range 0-15). The mean scores and standard 
deviations are provided below: 


15 point general ratings: 
Intermediate 
Initial (n=8) Final 


eee ee ee eee ee 
Experimental 3-44- 1°68 3:36= 1:80 3:26-—2-40 
Control VOL are ee — 2°73; eh72 


i 


Sum of scores (on five major categories): 
Intermediate 


Initial (n= 8) Final 
Experimental 5-32 =2°48 5:0 -2:44 44-28 
Control 3°52 = 1:59 = 4-1 =1-29 


The analyses of the 15 point ratings indicated that 
there were no significant differences either in initial 
ratings (Mann Whitney U=52; n=15 and n=10) or 
final scores (U=52°5: n=15 and n= 10) between the 
experimental and control groups. Similarly. intra 
group comparisons indicate that there were no 
changes over time in both groups (Wilcoxon 
matched pairs signed ranks: 1=40°5, n=15; t= 26°5, 
n=10). A comparison of final scores for the eight 
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individuals assessed soon after the workshop and the 
other seven experimental subjects indicated that the 
score distributions were not significantly different 
(U=32°5). 

The analyses of ratings derived from score counts 
(the total of five categories) indicated a similar lack 
of significant differences in both intra and inter 
group comparisons. The one exception was there was 
a barely significant decrease in scores within the 
experimental group between the first and final 
assessment. (Wilcoxon test: r=23, n=15, P<-05). 

Further analyses were conducted on the relation- 
ship between initial and final scores, and also the 
relationship between the 15 point ratings and the 
sum of scores from the five rating categories. Both 
general ratings and score counts were consistent over 
time for the experimental group. The rank order 
correlations were 0-93 and 0-87. The corresponding 
correlations for the control group. however, were 
0-32 and 0-18. Similarly. the relationship between 
general ratings and score counts was high and 
Statistically significant for the experimental group 
(rhos=0-94) for initial scores. 0-96 for follow-up 
ratings) but not for the control group (rhos= 0-26 
and 0-29). 

(iv) How satisfied were tne staff who attended the 
workshop with the teaching which was 
provided? The appendix provides data on 
the number and percentage of staff who 
considered that the sorkshop had been well 
presented and clear. interesting and relev- 
ant. Also included ar2 data on their opinions 
of whether they had learnt anything. 
whether the workshop would benefit others. 
and the extent to which the workshop had 
provided a statement of the ‘obvious’ or 
“common sense. 


Summary and conclusion 


The evaluation of the rehabilitation staff workshop 
has produced a number of interesting. relevant and 
sometimes surprising findings. 

The first is that staff awareness of the major steps 
involved in rehabilitation—namely assessment, goal 
setting, treatment, follow-up and = aftercare—is 
extremely limited. All scores of the response to the 
problem case were low and in that section of the 
score range which was clearly indicative of an 
inadequacy of response. 

The second finding was that the workshop did not 
Produce any improvement in staff performance. 
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Scores for the experimental group did not change. 
Furthermore, an assessment of staff knowledge soon 
after the workshop did not affect the adequacy of 
response at the final assessment. Repeated assess- 
ment does not therefore produce any effect such as 
the consolidation of information. This conclusion 
was further supported by the relative absence of 
significant practice effects in all groups. 

The final conclusion was that siaff opinionwas not 
an accurate guide to the effectiveness of the work- 
shop in improving their performance. A majority of 
the staff believed that the workshop had been well 
presented, interesting and relevant. Similarly, a 
majority thought that they had learnt something, 
and that a repetition of the workshop would benefit 
others. Yet the other data indicated no change in 
their performance on the rehabilitation problem. It 
is possible, of course, that there were changes which 
were not detected by the present measures. Whilst 
this possibility cannot be excluded, the present 
results do suggest that staff opinion is not necessarily 
a guide to the effectiveness of teaching provisions. 
Other measures of outcome (e.g. ratings of the 


‘ importance of rehabilitation) were. in fact. gather- 


ed: an inspection of the results, however. suggests 
that there were no changes. and that further detailed 
analyses wou!d not be justified. 

In his reviews of evaluative studies of psycho- 
therapy, Paul (1967) concludes that because of the 
importance of a wide range of factors in determining 
Outcome, research should attempt to answer quest- 
ions such as “What treatment. by whom. Is most 
effective for this individual with that specific 
problem, and under which set of circumstances”. It 
seems likely that the evaluation of educational and 
training programmes should be limited in a similar 
manner. In other words, the conclusions of this 
investigation are limited to this workshop. 

The analysis of results also revealed an interesting 
difference between the experimental and control 
groups. Retest reliabilities were lower for the 
controls (0°32 and 0°18, compared with 0:93 and 0-87 
for the experimentals); similarly. the relationship 
between the 15 point ratings and the sums of scores 
on the five categories were lower for the controls 
(0°26 and 0:29 compared with 0:94 and 0:96). These 
findings cannot be explained in terms of any obvious 
differences since the two research groups were homo- 
geneous in age, sex and professional background, 
and the ratings were conducted at approximately the 
same time. The worst inter-judge reliabilities were 
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also derived from the final assessments of the contro! 
group. Though there is no obvious explanation, one 
factor to be considered is the small size of the contro] 
group which might have contributed to the un- 
reliability since small absolute differences could have 
a disproportionally large effect on the final statistics. 

Whatever the limitations of the present results. 
they clearly demonstrate the need to evaluate 
educational provisions. Cochrane (1972), has dem- 
onstrated the need to evaluate treatment facilities 
within the National Health Service. This study 
indicates that controlled trials are equally important 
in relation to education and training. This conclusion 
is supported by similar results which have been 
derived from evaluation of other educational 
programmes. As has been indicated in the intro- 
ductery section. Quilitch (1975) demonstrated that a 
workshop in a mental handicap institution failed to 
change ward behaviour. and also that stat? opinion 
of the workshop was not an accurate guide to its 
effectiveness. His review lists other examples of 
limitations in educational programmes. 

In conclusion. the present study does not indicate 
that all «workshops or seminars are ineffective. The 
results clearly cannot be generalized. The results do 
suggest. however, that more attention needs to be 
i2\oted to evaluating educational provisions in the 
Health Services. The time devoted to this particular 
evaluation has also been very cost effective in that it 
has revealed a serious limitation in this particular 
educational provision. and has prevented a further 
expenditure of time and effort which would have 
been involved in repetitions of this workshop. 
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Appendix 


Below is the questionnaire administered to staff who 
attended the workshop. Data on their ratines are 
also provided: the total number of ralings is wenty: 
Do you feel that, en the whole, the course was well 
presented? In other words, was it presented in a 
manner which was clear and easy to understand? 


Extremely clear | 
Very clear 16 
Moderately clear 3 
Not really clear 0 
Not at all clear 0 


- How interesting was the course ? 


Extremely interesting 0 
Very interesting 10 
Moderately interesting 9 
Slightly interesting | 
Not at all interesting 0 


sd 
é) 

80°, 

js? 
6°, 
O°; 


0°, 
50°, 
4s" 

ar 


ny 


Do vou feel that the course has been relevant to vour 


work with patients? 


Extremely relevant 2 
Very relevant 10 
Moderately relevant 7 
Of slight relevance | 
Not at all relevant 0 


10°, 

So? 

3525 
5°, 
“tide 


‘Have vou learnt anything from the course which you 


could apply in vour work ? 
A great deal 
A fair amount 
One or two things 
Not much 
Nothing at all 


onwnntn ts 


— ty) PP to 
‘sa 


Oo tn 
5. 
° 


So 
< 


‘Do you feel that a course like this might benent other 


staff? 
Certainly iz 
Probably 5 
Possibly 3 
Probably not . 


Very unlikely 


‘Do you feel that the course, or any 


60°, 
oo. 
6°, 
Ore 
0's 


part of it, provided 


. . ‘ "9 . 
a statement of the ‘obvious’ or common sense’? Tick 


below to indicate vour judgement.’ 


None of it 0 
A very small amount | 
A certain amount 11 
A lot of the course 4 
Most of the course 4 


0", 
3 
55% 
aU 5 
+e 
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evaluation of family 


planning communications 
in El Salvador 


by Jane T. Bertrand, Jose David Araya Zelaya. 
Rosa Judith Cisneros and Leo Morris 


Over the past two decades, family planning (FP) has become one of the most widely 
promoted practices in the history of social development programmes. Before 1960 
only a few countries had any type of organized FP programme. By contrast, as of 
1977, 35 countries in the developing world had an official policy to reduce population 
growth, and another 30 gave official support to FP activities for other than 
demographic reasons. In other words, over 90% of the persons in developing 
countries now have governments that to some degree support family planning 
(Nortman and Hofstatter 1978). 


One of the primary means of promoting family planning has _ been 
information-education-communication (IEC) programmes designed to inform the 
target population about the availability of family planning and to motivate them to 
adopt some form of contraception. In general, IEC is considered to be one of the 
essential elements of an FP programme, along with effective contraceptive methods 
and an adequate delivery system (Rogers 1973b). 


The nature of IEC programmes for family planning has varied greatly from country 
to country, depending on the degree of support from the government for FP, the 
availability of resources to produce and diffuse communications, and the creativity 
of the personnel involved, to mention a few factors. Conventional means for 
promoting FP include both mass media (e.g. radio, television, posters, pamphlets, 
newspapers, billboards, movies) and directed interpersonal communications (e.g. 
individual patient education and counselling, group meetings, home visits, 
presentations in factories) as well as rather unusual vehicles such as elephants and 
other moving “exhibits,” signs in rickshas, and airdrops, to mention a few (Schramm 
1971, Sweeney 1977). 


JANE T. BERTRAND Is Assistant Professor at the School of Public Health of Tulane University, 
New Orleans. Jose Davip ARAYA ZELAYA is Chief of the Department of Planning Evaluation 
and Research, Salvador Demographic Association, San Salvador, and Rosa JUDITH CISNEROS Tf 
then, Executive Director of the same Association. LEO Morris is Chief of the Program 
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IEC programmes are expensive, especially wh : 

channels used by commercial 5 RM hg sy degree aa moun ane 
programme directors, and others to ask what they are getting ee : agencies, 

The answer to this seemingly simple question is often difficult to suhaaaeel 

of reasons relating to research design. Some would argue (Haskins 1968) th so oe 

valid means of determining the effect of a communications pro teem . 
controlled field experiment (e.g. a before/after study in an seen ore and r 

group). Yet this design has proven impractical for countries with a Brine emg 
programme, thus eliminating the possibility of locating a representative control 

group. Moreover, if the programme is already in motion (or has been a number of 

years), one cannot get a valid “before” measurement. Available service statistics or 
contraceptive sales records may show upward trends, but without the proper design 

it is impossible to determine to what degree (if any) these Increases were brought 

about by the communications programme. 


One such country faced with this dilemma was E! Salvador. In 1978 the Asociacion 
Demografica Salvadorefia (ADS, the Salvadorean Demographic Asociation) was 
keenly interested in evaluating its IEC programme, which had by that time been in 
operation for over a decade. As of 1974 the government adopted an official policy 
to reduce population growth in this country, and for a number of years El Salvador 
had one of the most aggressive communication programmes for family planning in 
Latin America (Morris er al. 1979). Considerable funds were invested in IEC 
programmes over this period ; yet there was no tangible evidence as to whether these 
communications had reached the target population and had had any effect. 


Because the IEC programme in El Salvador was nation-wide and had been running 
for a period of time, a controlled field experiment to determine effect was out of the 
question. Rather, a different type of evaluation was designed to take advantage of 
the nation-wide Contraceptive Prevalence Survey (CPS), also to be carried out in 
1978 in El Salvador (Asociacién Demografica Salvadorefia 1980). It was recognized 
that a one-shot survey of the target population would not measure effect per se but 
would, nonetheless, provide information regarding the reach of IEC activities to date 
and suggest appropriate modifications for future programmes. Specifically, data 
collected as part of the larger CPS demonstrated : 


In terms of past and current activities: 


a) the reach of IEC programmes to date, via the mass media and interpersonal 
channels, 


b) the source from which the target audience first learned of FP, 


c) the socio-demographic characteristics of those who had had relatively less 
exposure to FP messages via mass OF interpersonal channels, and 


d) the relationship between levels of exposure to FP messages and the current use 
of contraceptives; 


For future IEC efforts: 


e) the most important obstacles to FP, which would be dealt w 
through interpersonal channels, and 


f) the most effective scheduling of messages and programmes 


One of the chief advantages of collecting data regarding FP communications #5 Pit 
of the Contraceptive Prevalence Survey (known as FESAL-78) was defining 4 y 


ith in the media or 


on the mass media. 
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population that contained a representative sample of El Salvador’s women of 
reproductive age. Details on the research design follow. 


Research design 


The sample for the Contraceptive Prevalence Survey represents a subsample of the 
Encuesta Nacional de Hogares (National Household Survey) for which the sampling 
frame had been updated earlier that year (1978) by the Ministry of Planning. 


For the CPS the country was divided into three strata: metropolitan San Salvador 
(the capital city), other urban areas, and rural areas. Approximately 1,300 house- 
holds were selected per strata. 


Two-stage probability sampling was used. In the first stage, sectors of approximately 
50 households (which constituted the primary sampling unit) were randomly 
selected. In the second stage clusters of households were selected from these sectors: 
nine per cluster in the metropolitan and other urban areas, 16 per cluster in the rural 
areas. A total of 4,076 households was selected at random according to this design, 
and 2,962 women aged 15 to 49 years were identified as eligible respondents for this 
survey; completed interviews were obtained from 79% of the total. 


The probability of selection was not the same for each strata. The metropolitan and 
other urban areas were oversampled; in the survey they each represent 32% of the 
sample; yet these areas actually constitute only 20% and 25% of the population of El 
Salvador, respectively. Conversely, the rural area was undersampled; it represents 
36% of the sample but actually represents 55% of the population of the country. 


Also, the probability of selection varied by household. Only one woman of 
reproductive age (15 to 49 years) per household was interviewed, such that the 
probability of selection was inversely proportional to the number of women of 
reproductive age in the household. To adjust for these unequal probabilities of 
selection (by strata and household), weighting factors have been applied to the data 
presented below. With the sample drawn in this manner, the variable ‘‘current use 
of contraceptives” has a standard deviation of approximately 3% with a 95% 
confidence interval, including design effect. For each stratum this variable has a 
standard deviation of 4-6%. 


The questionnaire used to obtain the data was pretested in the field before the survey 
and modified accordingly. All interviewing was carried out by trained female 
interviewers between August and December 1978. The data were later coded and 
computer edited before data analysis began. 


Results 


The results of this survey fall into two categories: those that reflect past and current 
IEC efforts (Sections A to D below) and those that provide guidance in the design 
of future efforts (E and F). 


A. THE REACH OF IEC PROGRAMMES TO DATE 


In the study reported on here, all respondents were asked whether they had seen or 
heard a message on family planning via any of six mass media (radio, a, 
newspapers, movie theatres, posters, or pamphlets) or through any of three 
interpersonal channels (discussions with health personnel, home visits from an FP 
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worker, or public meetings on FP). Those who answered “yes” were classif ; 
having been exposed to FP messages via that medium or channe! a 


One of the key findings was that the overwhel 3 

Salvador—urban or rural—have been exposed to Peart dn oe - 7 
or interpersonal channels. As shown in Table 1, over 90% of the res - either mass 
seeing or hearing messages from the mass media. A much a dive ey tr 
received FP information through interpersonal channels. Guati Wan of 1 
women in metropolitan San Salvador had been reached by IEC efforts: | e t e 
areas the figure dropped only to 93.3%. >» In the rural 


TABLE 1: EXPOSURE TO FAMILY PLANNING (FP) MESSAGES V 
AND INTERPERSONAL CHANNELS, EL SALVADOR. 1978 — 


Percentage of respondents who Total Metropolitan Other Rural 
have seen or heard about FP via: San Salvador urban 

At least one of 

the mass media 93.7 99.3 97.4 90.6 
At least one of 

the interpersonal channels 52.0 64.2 56.8 46.5 
Al least one mass 

or interpersonal channel 95.5 99.6 98.1 93.3 


Of the various media or channels, radio has reached more people with FP messages 
than any other medium (see Figures | and 2). In the rural areas 85.0% had heard an 
FP radio spot, a figure that rose to 90.2% for other urban areas and 94.2% for the 
metropolitan area. If one takes into consideration only those women who have access 
to radio, the percentage who heard an FP spot on radio increases to 97.5%, 98.1%, 
and 96.0% in the three areas, respectively. 


Slightly over one-third of those exposed reported having heard the spots either 
“today” or “yesterday”; and over half of those exposed (58.5%, 65.6%, and 60.5% in 
the three geographic areas, respectively) had heard an FP spot within the past week. 


None of the other channels—mass or interpersonal— reached even half (50%) of the 
total population. After radio, the most far-reaching medium was written pamphlets, 
which 64.1%, 54.5%, and 39.6% of the respondents from the three geographical areas 
reported having seen. The majority had seen these FP pamphlets at the 
governmental health clinics, although respondents from metropolitan San Salvador 
also mentioned seeing them at the social security clinics, having them at home, or 
seeing them at ADS clinics. Similar to pamphlets in extent of reach were FP posters 
(see Figure 1), primarily at governmental clinics. In the metropolitan and urban areas, 
other locations also mentioned with some frequency were the social security clinics, 
commercial outlets, and the ADS*. 


* These data on “location” exemplify the difficulty of “evaluating” the communications 
programme of a given organization In a country where several Institutions provide FP eben? 
In El Salvador, the ADS was the sole producer of IEC materials for family planning from ‘ a 
to 1976, and from 1976 onward has been responsible for supplying the Ministry sage enh 
the Social Security Institute with materials. As such, these data on “location” Indicate the aa 
at which people have been reached although they do not necessarily reflect the source © 


materials. 
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ents and newspaper advertisements were effective in 
less so in other urban and rural areas. 
f reach have been advertisements in 


Television announcem 
reaching women in the metropolitan area, but 


Least effective of the mass media In terms O ae 
movie theatres. This reflects the fact that there has been no systematic campaign in 


movie theatres, that not all areas have movie theatres, and not all of the population 
would have access to movies because of geographic or financial factors. 


jug 


<4. FIGURE |: THE REACH OF FP MESSAGES 
VIA THE MASS MEDIA 


FIGURE 2: THE REACH OF FP MESSAGES 
VIA INTERPERSONAL CHANNELS 
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As for interpersonal channels, person-to-person communication with doctors, nurses, 
and other health personnel was an important information source for the target 
population. In fact, in rural areas more people reported receiving FP information 
from this source than from any other channels except radio. And in the metropolitan 
and urban areas, over half the respondents claimed to have participated in this type 
of communication. 


Approximately one-quarter of the respondents had attended some type of public 
meeting about family planning. And only a small percentage (6% or less) had 
received a home visit from an FP worker. 


In summary, for the total sample of respondents, the channels of communication for 
FP messages can be ranked as follows in terms of their reach in El Salvador: 


Channel 


Channel % reached % reached 
Radio 87.8 Public meetings 27.4 
Pamphlets 47.3 Newspapers 25.9 
Discussions with Television 20.9 

health personnel 46.8 Home visits 5.3 
Posters 43.2 Movie theatres 4.6 


The reach of each mass medium was greater in metropolitan San Salvador than in 
other urban areas, which was in turn greater than that in rural areas. As for the 
Interpersonal channels, this held true only for discussions with health personnel. 
Nonetheless, the data in Figures 1 and 2 clearly reflect the fact that less FP 
information has reached’the rural areas than the urban centres. 


ANNEX II] HMD/ 83.3 


- vil - 
B. INITIAL SOURCE OF INFORMATION ON FAMILY PLANNING 


Communicators are often interested in knowing how people learn about FP for the 


first time. The study reported on here included a 
question to ob - ing 
and the responses are presented in Jade 2. tain this information, 


TABLE 2: INITIAL SOURCE OF INFORMATION ON F 
BY AREA OF RESIDENCE SNNING. 


Source Total Metropolitan Other Rural 
San Salvador urban 
Radio 13.0 2.9 8.5 17.7 
Relatives-friends 2.2 0.7 1.1 3.0 
Doctor-nurse 1.4 0.2 0.7 2.1 
TV 0.1 0.2 0.1 0.1 
Printed material, movies 0.1 0.4 0.2 0.0 
Social worker 0.0 0.1 0.1 0.0 
Two sources 23.7 11.3 22.4 28.3 
Three or more sources 56.7 84.0 64.1] 45.5 
Other 2.7 0.2 2.8 3.3 


The vast majority of respondents did not mention just one source but rather multiple 
sources. In fact, inthe metropolitan and urban areas the majority mentioned at least 
three different sources. Since there are a great number of possible combinations of 
sources, they have not been listed separately in Table 2. 


Given that FP campaigns have now been running for more than ten years and that 
the majority of Salvadorean women have known about family planning for some 
time, it is possible that many may no longer remember clearly where they first 
learned of family planning. This would partially explain the multiple answers to this 
question obtained in this study. 


C. SOCIO-DEMOGRAPHIC CHARACTERISTICS THAT RELATE TO EXPOSURE To FP 
MESSAGES 

It was useful for communicators to be able to identify subgroups within the target 

population that had received lower-than-average exposure to FP messages. For 

example, from the tables above it is clear that rural women had had less exposure 

than their urban counterparts. Our analysis indicates other characteristics of women 

who have been less likely than others to receive FP messages. 


Six socio-demographic variables have been analyzed in relation to amount of 
exposure to FP messages (see Table 3). To identify which variables affect amount 
of exposure, an exposure score (number of channels through which the respondent 
had been exposed to FP messages) was computed for each calegory of the variable. 
Categories with the lowest score represent the women least likely to have been 
reached by IEC efforts to date. 


All six socio-demographic variables were shown to relate to amount of exposure to 
FP messages. As shown in Table 3, exposure was lower among women: who live in 
rural areas; who have no employment or work at home, who have relatively a 
education; who are not married or in union, who are under 19 or over 40; who have 
no children or who have many children. 
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TABLE 3: SOCIO DEMOGRAPHIC FACTORS AND LEVELS 
OF EXPOSURE TO FP MESSAGES 


Variable Categories Exposure Variable Categories Exposure 
score! score 
Place of Metropolitan San Salvador 4.5 Employment Not employed ae 
residence Other urban 3.5 Works at home 3; 
Rural oe: Works outside 3.8 
Education No formal schooling 2.2 Age 15-19 z5 
Completed primary |, 2 or 3 2.9 20-29 3.6 
Completed primary 4, 5 or 6 3.5 30-39 3.3 
Attended secondary or higher 4.5 40-49 2.6 
Marital Married 34 Numberof 0 3.0 
stalus In union 42 living 1-2 +5 
Separated or divorced 3.1 children 3-5 3.4 
Widowed 2.6 6-13 2.6 
Never married 2.6 


| This exposure score refers to the number of channels through which the respondent was exposed to FP mes- 
sages (possible range: 0 to 9; average score for the total sample: 3.09). 


This analysis suggests that the reach of acommunications programme Is affected not 
only by the intensity of the IEC effort but also by the personal situation of members 
of the target audience. Those women in greatest need—married or in union at the 
peak of their reproductive year—undoubtedly had higher levels of exposure from 
seeking out FP information. In addition, exposure was higher for those who had 
greater contact with the outside world, either through schooling or employment 
outside the home. Finally, the fact that the lowest levels of exposure were found in 
rural areas reflects not only less accessibility to media and to interpersonal FP 
activities, but also lower levels of education of this population. 


D. LEVELS OF EXPOSURES TO FP MESSAGES AND THE USE OF CONTRACEPTIVES 


It is the working assumption of most IEC programmes that the more extensive the 
communication effort, the greater the number of contraceptive users. Unfortunately, 
a “‘one-shot”’ survey cannot be used to prove that greater communication efforts 
cause increased use of contraception. Indeed, some would argue that those using 
contraceptives would be more attentive to communications about family planning 
since they relate to their own behaviour, and that they thus would have greater levels 
of exposure to FP messages. 


The results of the contraceptive prevalence survey show that 34.4% of Salvadorean 
women, married or in union, age 15 to 44 are currently using contraceptives. The 
percentage of users is higher in metropolitan San Salvador (56.4%) than in other 
urban areas (41.9%) or in the rural areas (26.2%). The full results of the CPS are 
published elsewhere (Asociacién Demografica Salvadorena 1980). 


For the purpose of this analysis it is of interest to test the relationship between levels 
of exposure to FP messages and levels of contraceptive use. To this end the ‘use of 
contraceptives’’ has been defined in terms of the distinct stages defined by Rogers 
(1973a). In this analysis these stages have been operationally defined as follows 
(categories are mutually exclusive): 


Yet to begin the adoption process : knows no contraceptive methods; is not interested 
In using contraceptives; has never used contraceptives. 


Awareness-knowledge of the innovation: knows at least one method; is not yet 
Interested in using contraceptives; has never used contraceptives. 
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Persuasion of a favourable attitude : knows at least one method: expresses interest in 
using contraceptives; has never used contraceptives. 


Decision to adopt the innovation: has used a contraceptive method in the past (but is 
not currently using). 


Confirmation of this decision: \s Currently using a contraceptive method. 


Since educational level was shown to have an effect on the level of exposure to FP 
messages, we statistically controlled for this factor in our analysis in order to clarify 
the relationship between exposure and contraceptive use (Figure 3). 


te ee a) FIGURE 3: 
pee Ee EA AVERAGE EXPOSURE TO FP 
THE ADOPTION PROCESS! 


'Based on women 15-44 years old, 
married or in union. In this analysis 
education was entered as a COvariale; 
as such, the variable education has 
been controlled for in this figure. The 
possible range for the exposure scores 
is 0-6 (mass media), 0-3 (interpersonal 
channels), and 0-9 (combined chan- 
iene aati nels). 


Average “expmure score oo FP meseages 


The data from Table 4 and Figure 3 illustrate two aspects of contraceptive usage in 
FE] Salvador. First, women in metropolitan San Salvador are much further along in 
the adoption process than those in other urban and rural areas. Conversely, the 
percentage who are aware of FP and know at least one contraceptive method but 
have no interest in using contraceptives is lower in the metropolitan area (18.0%) 
than in other urban (36.6%) or rural areas (47.0%). 


It is of interest that less than 1.0% of the population, even in rural areas, are not aware 
of at least one contraceptive method, this, In part, reflects the aggressiveness of IEC 


TABLE 4: STAGES IN THE FP ADOPTION PROCESS 
BY AREA OF RESIDENCE ! 


PERCENTAGE FROM EACH REGION AT THE 
DIFFERENT STAGES OF ADOPTION 


Stages pain ay Total Metropolitan ga Rural 
gee rahe tment 0.6 0.2 0.2 0.9 
. nn ere fT Rant ite wetted 40.2 18.0 36.6 47.0 
"6 Ce eau ualhé an FP method 11.8 7.4 19 14.3 
mi Deca cvesidet fp tieciod 13.0 18.0 13.4 11.7 
ST RARER ais Win. boted AR: 0882 


nion 
1 Since the data in this table involve contraceptive usage, only women 15-44 years old, marred or in u 
are included in this analysis. 
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activities in El Salvador. Data from a similar study carried out in the BAisheRHAAE 
country of Guatemala indicate that a much higher percentage (16.6) of GABE: an 
women do not know at least one contraceptive method (Pineda er al. 1980). 


Of particular note is the relationship between exposure to FP messages (as reflected 
by the average “exposure score” or number of channels via which the respondent 
has heard of FP) and the adoption of family planning. As shown in Figure 3, those 
women who have yet to begin the adoption process (have not heard of even one 
method) have the lowest exposure scores—via mass media or interpersonal 
channels. These scores are higher for those who are at the knowledge-awareness 
stage, and they continue to rise monotonically with each stage in the adoption 


process. 
Although it is not possible to interpret this relationship as cause and ef fect, these data 
do provide evidence of a strong association between FP communications and the adoption 


of a contraceptive method. 


E. OBSTACLES TO FAMILY PLANNING: CONTENT FOR FUTURE PROGRAMMING 


In a country where the overwhelming majority of the population know of family 
planning it is the responsibility of an IEC programme to go beyond promoting 
awareness. Rather, an effort must be made to identify existing obstacles to family 
planning, which should then be the focus of further IEC efforts. 

To this end, all respondents were asked to rank the importance of a series of possible 
reasons for not using family planning for couples in general (Table 5). Heading the 
list was the lack of husband-wife communication about family planning (rated by 
64.9% of the respondents as ‘“‘very important’’), followed by rumours people have 
heard about the methods (61.2% considered this to be “‘ very important”’). Third most 
important was the belief that FP goes against God’s will (49.2%). And nearly the 
same number felt that people do not worry enough about the future of their children 
(48.6%). 

Other reasons include the belief that people need to have more children to help them 
in their old age (41.6%) and that people do not have sufficient knowledge of all 
contraceptive methods (38.6%). Other items, rated as less important by the 
respondents, include the following : people want to have more children (36.9); people 
accept the pregnancies that occur without worrying about it (36.7); people need to 
have more children to help them with work (economic value of children) (33.2) 
people prefer male children and keep having children until they have sons (33.7); 
people worry about what their friends and neighbours would think of them (28.3): 
and people don’t know where to get contraceptive methods (22.7). 


The importance assigned to these different factors clearly varies by geographic area. 
In general, the percentages of respondents who classified a given factor as a “very 
important reason’’ for couples not using contraceptives were lowest in the 
metropolitan area and highest in the rural area, suggesting the greater acceptance of 
FP in the former. 


Within this general pattern it Is interesting to note the relative importance given to 
the different factors. All three groups ranked “lack of husband-wife 
communication” and “rumours” in first and second place, respectively. Yet with 
other variables there were notable differences. For example, metropolitan and urban 
respondents considered the third greatest obstacle to be that “people don’t worry 
enough about the future of their children’, whereas rural women gave more 
Importance to religious beliefs, infant mortality, and support in old age. 


a i aa el 
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Another marked difference involved the economic value of Children, seen as an 
important factor in rural areas but given the least importance of all the sentiad 
obstacles by the metropolitan population. Likewise, the urban population was much 


less concerned than the rural as to what friends or nei ; 
ghbours wo 
using an FP method. uld think of their 


While not all the reasons discussed above can be dealt with directly in a 
communications campaign, a number of these items could usefully serve as a basis 
for the content of future IEC efforts. 


F. EFFECTIVE SCHEDULING FOR MESSAGES IN FUTURE IEC PROGRAMMES 


As described above, radio has reached more of the women in EI Salvador than any 
other medium or channel. Indeed, our study shows that 78.9% own radios and 
another 11.8% can listen to a radio elsewhere. This makes a total of 96.6%, 91.9%, 
and 88.5% of the women in the metropolitan area, other urban areas, and rural areas, 
respectively, who have access to radio. 


In terms of scheduling programmes or spots on radio, it is important to consider the 
most popular listening times and favourite programmes of the target population. Our 
study indicates that more women listen to radio between 8 a.m. and 12 noon than 
at any other time in all three geographic areas. The second most popular time in all 
three areas is from 2 p.m. to 6 p.m., followed by 6 p.m. to 10 p.m. 


Without question the most popular type of programming is music (mentioned by 
78.3%, 71.2%, and 65.0% of the respondents in the three geographic areas, 
respectively). News rated second (mentioned by 10.9%, 11.7%, and 15.2% of the 
respondents), followed by the novelas of soap operas (6.4%, 8.3%, and 9.5%). 
Religious, educational or sports programmes were mentioned infrequently (see 
Figure 4). 


FIGURE 4: FAVOURITE TYPE 
OF RADIO PROGRAMME, 
BY AREA OF RESIDENCE 


METROPOLITAN 


[__] Music 


woes = NEWS 


GFF, SOAP OPERAS 


RURAL RRS OTHERS OTHER URBAN 


Television reaches a much smaller segment of the population than does radio. While 
72.1% of the respondents in metropolitan San Salvador reported to have TV or to 
have access to a set at least once a week, this percentage drops to 40.3 in other urban 
areas and to a mere 10.7% in rural areas. Thus, it cannot be considered a potentially 
effective means for reaching the target population outside the metropolitan areas. 
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If TV programming Is used to reach the target population, it should be noted that 
the peak listening time is between 6 p.m. and 10 p.m. with the period from 12 dais 
to 2 p.m. a distant second. The decided preference for female viewers in all 
geographic areas was for the novelas or soap operas followed by adventure and 
comedy shows. 


implications of the findings 


Although this survey does not directly measure the impact of ten years of IEC 
programming on the use of contraceptives in El Salvador, it nonetheless provides 
useful and thought-provoking data regarding FP communications which are of 
interest not only to this country but to programme planners in other parts of the 
world. 


Our findings reflect the fact that El Salvador had one of the most aggressive IEC 
programmes for family planning of any Latin American country during the 1970s. 
That almost 100% of the women in the capital city and over 90% of rural women have 
seen or heard FP messages via at least one mass or interpersonal channel attests to 
the coverage of this programme. Of the various media, radio has been by far the most 
effective in reaching the women in El Salvador. 


However, not all segments of the population have been reached to the same extent 
(as measured by the number of channels through which the respondent had heard 
of FP). Exposure has been lower among women: 


— who live in rural areas; 

— who have no employment or who work at home; 
— who have relatively little education; 

— who are not married or in union; 

— who are under 19 or over 40; or 


— who have no children (and thus may perceive no need) or many children (and, 
thus, may consider it too late). , 


One of the points highlighted by these findings concerns the importance of 
establishing effective communication with women 15 to 19 years old, who will be 
influential in tomorrow’s demographic situation. 


It is also useful to consider the types of communication that have been used to date 
for reaching the target population. The mass media are generally considered to be 
effective in promoting knowledge and awareness, whereas interpersonal 
communication is important in bringing about attitudinal and behavioural change 
(Rogers 1973a). Our data reflect the efficacy of the mass media (especially radio) in 
diffusing information about family planning; indeed, less than 1% of women, even 
in rural areas, did not know of at least one contraceptive method. However, the 
percentage of women reached through “programmed” interpersonal channels (such 
as health personnel in a clinic, group meetings, or home visits) was much lower. 


The disparity between knowledge and use of family planning which Currently exists 
Is a universal problem. Education interventions are based on the premise that the 
problem has its roots in specific identifiable causes and that these causes can be 
corrected by appropriate communication-education programmes (Bogue 1975). In 
the present study the main obstacles include: 


— the lack of husband-wife communication; 
— fumours people heard about the methods; 
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— the belief that FP goes against God's will: and 
— the lack of concern over the future of one’s children. 


While it could be counterproductive to deal with certain themes (such as religious 


beliefs vis-a-vis family planning) via the mass medi: 
la, these c 
addressed in interpersonal exchanges. oncerns could be 


Our survey indicates the potentially most effective times for schedulin 
programming as well as the preferred types of programming, to allow for en 
use of mass media in future IEC programmes. The fact that programmes with music 
are by far the most popular type among the target population suggests two strategies: 
(1) to concentrate one’s FP spots during musical programmes; or (2) to use more 
musical introductions, tags, or jingles as part of the FP communication itself. 


The results of this survey are useful in several respects. Apart, from its value to the 
programme directors and communicators, the survey is important from the point of 
view of communications research involving nationwide programmes. In the past, 
most communication programmes for social development were carried out without 
the benefit of follow-up research. In part, this has been the case because of the 
expense involved in undertaking a nation-wide survey with a probabilistic sample. 
However, by adding a set of communications questions to the standard items on the 
contraceptive prevalence survey, It was possible to obtain data from a representative 
sample of the target population (women of reproductive age) at marginal cost. At 
least in the area of population and family planning, this represents a useful, practical 
mechanism for obtaining information on existing communications programmes and 
providing guidelines for future efforts. It should be equally applicable to other topics 
for which nation-wide surveys are also carried out. 
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Diarrhoeal disease has long been recognised as the 
main killer of infants and young children in the 
developing world. 

Gastroenteritis, the name given to most diarrhoeal 
episodes in childhood in both developed and 
developing worlds remains a major health hazard in 
paediatric practice. It is a major cause of morbidity 
and mortality among preschool children of the 
deveioping world. During the first year of life, 
children in India have an average 5 to 6 episodes of 
diarrhoea a year (Maiya ef al. 1977). 

Poor socioeconomic conditions, illiteracy, poor 
sanitation and drainage system and lack of safe 
water supply are but a few of the factors causing the 
prevelance of diarrhoea and malnutrition in the 
developing world. It is estimated that 78% of the 
rural population in the third world is without clean 
water supply and 85% is without adequate sewage 
and other excreta disposal facilities (Agarwal, 
A. 1979). 

The impact of water restriction on health was also 
studied during a severe drought in Haiti. Diarrhoea 
rates were seen to be higher for children from homes 
using less than one can of water per person per day 
(Thacker ef al. 1980). Shortage of firewood, as 
shown in U.K. M.R.C. study in Kenaba, Gambia, 
has forced the people to cook their food in advance 
especially in the rainy season. This made the food 
of infants and young children overgrown with 
bacteria even after cooking (Barrell and Rowland 
1979). 


Incidence and Seasonal Variation 


Diarrhoea is the most common complaint in 
children below the age of 5 years during the summer 
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months. The incidence varied slightly amongst 
different reports from various developing countries. 

Sunoto ef al. (1977) gave a figure of 22.8% of 
total admissions to university hospital in Jakarta, 
Indonesia. This figure is similar to those from other 
developing countries such as Malaysia (Abraham 
and Tan, 1974), India (Naruka er a/. 1974), Puerto 
Rico (Oritz, 1974) and elsewhere. (Hernawan ef al. 
1978). In west Azerbaijan, Iran, primary health care 
project (1972) revealed a figure of 22.2% for diarr- 
hoeal complaint in children under the age of 5 years 
during the summer months. The study was analysed 
further to show that by 1976 the incidence was 14% 
in summer and 4% in winter of the health centre 
attendance (Barzgar ef a/. 1980). 

The summer peak for diarrhoeal diseases has also 
been shown in reports from India (Arora ef al. 1955, 
Sarin ef al. (1957), Sood (1963) and Dutta er al. 
(1974) (Datta Banik, 1979) and South African Black 
Population (Spencer and Coaster, 1969). In Jordan 
with 20% of admissions to paediatric unit at Jordan 
university hospital being for diarrhoea reach a 
figure of 40% in late summer and early autumn 
(Khuri-Bulos and Hamad, 1980). 

The overall incidence of gastroenteritis in develop- 
ing countries is estimated as 50-70 % per 100 popula- 
tion per year. The above mentioned figures from the 
developing world contrast with those from the 
developed world in having a winter peak and less 
incidence of diarrhoeal episodes among hospital 
attendants; for example 7.5 % from England. (Tripp 
et al. 1977). 


Sex and Age Incidence 


Various studies in the developing world showed 
higher frequency of males affected with diarrhoeal 
diseases than females, for example Goa, India 3:2 
(Mavinkurve and Ferrao, 1979). Indonesia 1.8:1 
(Hernawan ef al. 1978), Jordan 2.2:1 (Khuri-Bulos 
and Hamad, 1980). There were similar views in 
reports from the developed worid as that from 
England 2.4:1 (Weindling et al. 1980). Most studies 
reported a peak age incidence between 6 months and 
a year. 
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Table | 
Rates of identification of bacterial and viral pathogens in the developing world 
PI CEN 7 eee reer eenren ay Ma TTR SAR Pea, eee Ree eaten een, dhe de 


Viral (%) Positively 


Country Number of Children Identified Bacterial (%) References 
eee 
Goa, Indi 210 looked f abi 

oa, India not loo or 35.2% (E. coli , 
Southern India 50 26% $6 % ? ee a, ame 
Indonesia 100 not looked for 13% Sunoto et al 1977 
Fe = 7 68.77% Sunoto et al. 1978 
ordan 191 = 8% Khuri-Bulos & Hamad 
1980 
Northern Nigeria 21 61% 10% D 
pa er = 4% 718 ossetor et al. 1979 
(50% single pathogen) Robins Browne et ai. 1980 
(43% E.P.E.C.) 
pa 37 6% by E.M. 81% (Enteropathogens) Schoub er al. 1977 
49% by R.C.F.T. 41% (Enterotoxigenic)* 
Bangladesh 45% Taylor er al. 1980 
55% (Enterotoxigenic)* Nalin et a/. 1975 
Taiwan 75 56% 16% E. coli Echeverria et al. 1977 


nae se AON ca a Sm A BE i a a ae a a 
E.P.E.C. = Enteropathogenic Escherichia coli. E.M. = Electron Microscopy. R.C.F.T. = Reverse complement 


fixation test. 


* In contrast with figures from the developed countries such as Britain (Gross et al. 1976) (Gribben ef a/. 1976) and 
United States ranging from 73% in Chicago (Gorbach and Khurana 1972) to zero in Boston (Echeverria et al. 1975). 


Causative Organisms 


The rates of isolation of bacterial or viral patho- 
gens varied in different reports from the developing 
world. This was influenced by the type and time of 
the study, its location, its objectives and by the 
status of health and education in that area. 

Table (1) elicits clearly the variable ratios of 
bacterial versus viral organisms in some of the 
studies performed in the developing world. 


Malnutrition 


Global improvement of nutrition is essential to 
break the link between diarrhoea and malnutrition. 

Anaemia and malnutrition were present at a high 
rate in an epidemiological survey of 2493 Preschool 
children in India. (Datta Banik, 1978). Schoub er al. 
(1977) reported that over half of black South 
African infants affected with acute summer gastro- 
enteritis showed evidence of malnutrition. Malnu- 
trition increases susceptibility to infection and 
infestation through lowering antibody production. 
The recognised associated complications of diarr- 
hoeal disorders and the resultant mortality rate also 
increase with increasing severity of malnutrition. 
(Kumar ef al. 1977). 


Breast Feeding 


The importance of breast feeding can never be 
over emphasized especially in the developing world. 


b 
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Its protective value against some respiratory, 
gastrointestinal and allergic disorders is well 
recognised. This is especially so if breast milk alone 
is given for the first six months of life and more so 
among the lower socio economic segment of the 
population. 

The World Health Organisation issued a report in 
1973 stating that in rural Chile, the infant mortality 
rate has risen due to the fall in the prevalence of 
breast feeding (Plank and Milanesi, 1973). 

Breast fed infants receive an initial bolus of IgA in 
colostrum in addition to IgG acquired through the 
placenta. This offers the baby better protection 
against various gastrointestinal disorders. The 
supply of antibody to the infant will continue with 
the continuing supply of breast milk. (Gerrard, 
1974). Thus breast milk may provide the basic 
essential aspects of immunity for the infant with 
defective host defence mechanism. (France et al. 
1980). 

sl Pan American Health Organization study 
(Puffer et al. 1973) has stressed the value of giving 
the young infants breast milk alone without addi- 
tional cow’s milk to ensure a better protection. The 
government of Papua New Guinea has made bottles 
for infants feeding available only on a prescription. 

Diarrhoea is more prevelant in infants of lower 
socio-economic status who are malnourished and 
artificially fed. Poor hygiene, increased rate of 
malnutrition and lack of adequate safe water supply 
predispose to infection. Breast milk will play an 
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important role in reducing the incidence and 
mortality rate of infantile gastroenteritis. (Schoub 
et al. 1977). With a decline in breast feeding and 
indiscrete advertising to encourage bottle feeding, 
acute gastroenteritis poses a major health hazard. 
There is an increased incidence of acute gastro- 
enteritis with dehydration as well as a greater risk of 
developing cows’ milk protein intolerance with 
enteropathy. (Walker-Smith ef a/, 1978). This can 
lead to the development of malnutrition from 
chronic diarrhoea as has been shown by Manuel 
et al. (1981) in their study on Indonesian Infants. 


Oral Rehydration Therapy 


The use of oral electrolyte solution containing 
glucose in the management of infantile diarrhoea 
was suggested by Darrow in 1949. Chatterjee in 1953 
made use of such therapy in the treatment of 186 
patients with mild cholera. It was later found that 
sodium transport and glucose transport are coupled 
in the small intestine so that absorption of water and 

- Salt can be accelerated by giving glucose (The 
Lancet 1975). 

Recently Ksiazyka ef al. (1981) performed 
perfusion studies in rat jejunum to compare the 
effect of sucrose and glucose on modifying cholera 
toxin induced intestinal secretion. The study gave 
further evidence of the usefulness of sucrose instead 
of glucose in oral rehydration therapy. This observa- 
tion has practical implications in the developing 
world. (Nalin et al. 1978, Estes and Graham, 1979). 

Controlled studies in Indonesia, Pakistan, Puerto 
Rico and the Philippines have all shown a major 
reduction in the mortality rate from diarrhoea since 
the introduction of oral rehydration therapy 
(Diarrhoea Dialogue 1981). Similar results have 
been achieved with such therapy in reports from 
Turkey (Bertan and Egeman, 1979), Iran (Barzgar 
et al. 1980) and Indonesia (Sunoto er al. 1978). 

The easy availability of antibiotics account for 
their frequent misuse for treatment of diarrhoeal 
disease in the developing world. Antibiotics are not 
Mecessary even in the very few cases of bacterial 
gastroenteritis. Sunoto er al. (1978), have concluded 
in their study on treatment of infantile gastroenter- 
itis in Indonesia that the results of the treatment are 
about the same with or without antibiotics. The use 
of antibiotics indiscriminately in Paediatrics in the 
developing world needs further appraisal. 


Morbidity and Mortality 


Diarrhoeal episodes are associated with a very 
high mortality rate reaching up to 20% among 
affected children in the developing world (Sunoto 
et al. 1974), Jordan 5% (Khuri-Bulos and Hamad, 
1980), India 5.1-6.5% (Datta Banik). This is 
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compared with rates from the developed countries 
like England at 1% (Walker-Smith, 1972). 

The aetiology for such high mortality rate is 
multifactorial. This includes severity of the diseases, 
inappropriate treatment, status of health and 
nutrition and ignorance of parents. 


Conclusion 


It is obvious that most of the gastrointestinal 
disorders in the developing world require essentially 
primary health care and very basic nursing manage- 
ment. Home based care for families and their 
infants at risk has to be encouraged. Oral rehydra- 
tion therapy has to be utilized more in the manage- 
ment of infantile gastroenteritis. A long term objec- 
tive must focus on improving water supplies, 
sanitation, health care facilities and promotion of 
breast feeding for young infants. 
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Introduction 


The period since 1945 has seen the emergence of 
aggregative economic concepts such as national 
income, gross domestic product and gross 
national expenditure as standard tools of 
economic analysis not only in the case of the 
developed countries but in virtually all develop- 
ing countries and also in relation to global 
comparisons of national incomes and outputs. 
During the latter part of the same period it has 
been increasingly accepted that national account- 
ing concepts can be used to provide information 
useful for the analysis of the determinants of the 
health status of populations, again at both the 
national and international levels. Of the possible 
links between national income and _ national 
health status, two have attracted particular 
attention. On the one hand, there is a strong 
statistical association between national per capita 
income and such indicators of national health 
status as infant mortality rates and life expec- 
tancy, suggesting some broad causal nexus 
between high incomes and better health. On the 
other hand, the national accounts provide a 
convenient framework for defining the share of a 
country’s resources which is devoted to health 
services, either through the public or through the 
private sector, how these resources are provided 
and financed, and who are the beneficiaries. 
Either of these types of relationship between 
income level and health may have considerable 
significance for the development of health on a 
global scale — that is, in practice, for the improve- 
ment of the health status of the populations of 
the developing countries. If emphasis is laid on 
the link between health and the general income 
level, improvements in health on the global scale 
depend on increasing incomes in the poorer 
countries of the world, which in current dis- 
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cussions is usually identified with a more equit- 
able international distribution of income. If we 
emphasize the link between health status and the 
provision of health services, we have to consider 
in addition whether it is possible to increase the 
share of national resources going to health and 
the effectiveness with which they are used. In 
either case there is an urgent need for data which 
are accurate and comprehensive at the national 
level and comparable at the international level. 

Unfortunately, in this area of convergence of 
national economic accounting and accounting for 
health sector resources, the data presently avail- 
able have not been wholly satisfactory. The 
conventions of social accounting were initially 
developed from a point of view which was 
national rather than international, and economic 
(in the sense of being concerned mainly with 
material production) rather than social. The 
translation of national aggregates into inter- 
national terms has almost universally been done 
by equating national currencies to the US dollar 
on the basis of market or official exchange rates. 
It has long been known that this is an unsatis- 
factory procedure, and particularly so in the case 
of services such as health care which do not enter 
into international trade. In the 1970s co-operation 
began between the World Bank, the UN Statistical 
Office and the University of Pennsylvania on the 
development of comparisons of gross domestic 
product based directly on purchasing power, 
rather than mediated by exchange rates. The 
results of this project are now becoming avail- 
able on a substantial scale, and the light they 
throw on the development of better health in 
poor countnes is discussed below. 

During the 1970s there has also been a steady 
and unspectacular improvement in the national 
accounting data available for the developing 
countries. This is reflected in the increasing 
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number of countries for which plausible esti- 
mates of gross national product, national product 
per capita, and annual growth rates are published 
in such sources as the World Bank Atlas, and the 
growing nymber of years over which such esti- 
mates are available. For a limited number of 
developing countries these estimates include 
fairly reliable data on the product of the health 
sector which can be correlated with indicators of 
health status. Even without the added accuracy 
and realism given by purchasing power compari- 
sons, these data permit us to draw some general 
conclusions about the influence of rising national 
incomes on health development, which are dis- 
cussed in the following section. 

The 1970s have also seen the continuation 
and expansion of another approach to the estima- 
tion of health sector resources in developing 
countries. In the 1960s WHO initiated a project 
for international comparisons of health expendi- 
ture whose reports laid the foundations for 
further work in this field. In particular, they 
identified many of the difficulties encountered 
in practice at the national level, and the main 
points at which national accounting conventions 
needed to be modified if expenditure data were 
to contribute effectively to the analysis of ques- 
tions of health policy. WHO has now begun a 
programme of support to national efforts at 
analysis of health sector financing within a stan- 
dard accounting framework, and detailed 
estimates for certain developing countries are 
becoming available (e.g. WHO 1977). 

Finally, it should be mentioned that the UN 
Statistical Office has attempted to redress the 
bias of national accounting toward narrowly 
economic problems through proposals for the 
development of a System of Social and Demo- 
graphic Statistics which would permit the linking 
of expenditures in the social sectors not only 
with the corresponding output of services but 
also with their impact on the welfare of the 
population. As originally envisaged, these pro- 
posals go considerably beyond the current dis- 
cussions of ‘social indicators’, but they do not 
appear to have had so far the impact which their 
importance deserves. 


The international distribution of income and its 
implications for health , 
There can be no doubt that the international 
distribution of income, product or any of the 
conventional economic aggregates is highly un- 
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cat hei condrae evidence that thes 
capita and measure tyes ae peer meme a 
mh ghar gm S Of national welfare such as 
‘ acy rates. These propositions 
ave led some writers on development to very 
mpseersninio cae ae ee 
of developing countries The ats a Sy Spec 
ei . the argument is seldom 
made entirely explicit, but put in its extreme 
form, and applied specifically to the health 
sector, it appears to be as follows. The cor- 
relation between national incomes per capita and 
indicators of health status, such as mortality 
rates, implies that no substantial improvements 
in the health status of the poorer countries can 
take place without a corresponding increase in 
their incomes. Such an increase in incomes 
implies a more equal distribution of incomes on 
the international scale. However, since the begin- 
ning of the UN First Development Decade in 
1960 this distribution has grown more unequal, 
as is evidenced by the fact that the poorest coun- 
tries show the lowest rates of growth of per 
capita incomes, Without massive specific inter- 
ventions, we may expect the international distri- 
bution of incomes, and therefore also of health, 
to become even more unequal in the coming 
decades. Any substantial improvement in the 
health status of the poorest countries is therefore 
unlikely. While this argument appears plausible, 
it is argued here that it is subject to considerable 
qualification at almost every step, and that there 
is room for cautious optimism about the health 
status of the population of the developing 
countries. 

The first point at which the pessimistic argu- 
ment needs to be qualified concerns the evidence 
for increasing international economic inequality. 
A broad association between low per capita 
income and low past growth rates is not of great 
significance, since low incomes may be in part 
the product of earlier slow growth, one would 
expect such an association to be found even in a 
population in which income levels and growth 
rates were randomly associated. If there is a 
systematic tendency for poor countries to grow 
more slowly in economic terms, it should be 
reflected in prospective as well as past growth 
rates. Table 1 shows countries with populations 
of more than 1 million in 1978, classified by 
their per capita income level in 1960 and their 
average growth rate 1960— 1976. (The data used 
in this table are taken from the 1978 edition of 
the World Bank Atlas which isa principal source 
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Table 1. Population of countries with more than 1 million 1976, by national GNP per capita 1960 (in 1976 $) and 
growth rate of GNP per capita 1960—1976* 


Growth rate of 1976 population (millions) of countries with 1960 GNP per capita of: 


GNP per capita, $5000 
1980-1976 = 4 x 
(% p.a.) $100 $100< $200< $500< $1000< $2000< _ and over Tot 
0 81.6 12.4 45.4 1.7 - - 1.0 142.1 
<1 12.0 65.1 1,8 + 2.8 - ~ 81.7 
21 28.7 663.0 65.3 40.6 1.1 - = 798.7 
>2 3.9 48.7 103.4 82.6 12.4 73.9 2218 546.4 
>3 5.4 211.3 111.7 77.3 329.7 138.1 8.2 881.7 
>4 - 45.2 8.3 i CS | 43.1 75.0 - ke Bi 
>5 rz 835.8 89.9 80.7 163.9 - - 1171.5 
Total 132.8 1881.5 425.8 434.0 $53.0 287.0 230.7 3944.8 
Average growth rate: 
GNP 23 6.0 6,78= 7A 6.3 4.4 3.6 5.0 
Population 2.5 2.1 2.6 2.7 1.1 0.8 1.1 1.9 
GNP p.c. 0.4 3.9 4.0 4.3 5.1 Bay 25 3.1 


* Source: World Bank Atlas (1977). 


of data on international economic development.) 
The table shows that the lowest growth rates 
were experienced by those countries which had 
in 1960 either very low incomes (less than US 
$100 per capita at 1976 prices) or very high 
incomes (more than $5000 per capita). Over the 
intermediate range any association between 
income level and growth rate is much weaker, 
with the maximum growth rate being in the 
income group $1000—1999 per capita. If such a 
pattem were projected into the future, one 
would expect it to produce little change in the 
overall concentration of income, but with some 
movement in favour of middle income countries 
as against both the poorest and richest. This is 
confirmed by a calculation for 1960 and 1976 of 
the coefficient of concentration of the country 
income data shown in Table 1; the coefficients 
for 1960 and 1976 are almost identical (0.822 
and 0.819). 

It is worth noting that one’s interpretation of 
such data may depend critically on one’s evalua- 
tion of the estimates for a small number of 
countries. Thus in Table 1 the lowest income 
category is dominated by Bangladesh, a country 
whose rate of growth has been deeply affected 
by the events surrounding the war of liberation 
in 1971, and which had no separate political 
existence before that date. The next income 
category is dominated by India and China, which 
between them account for about one third of the 
population of the countries covered by the 


table; in neither case is the statistical basis for the 
World Bank Atlas growth rate entirely satis- 
factory. 

Constancy in the degree of concentration of 
intemational incomes does not rule out a sub- 
tantial increase in the per capita income of the 
poorest countries. Given a continuation of the 
growth of average per capita GNP at the same 
rate as between 1960 and 1976, and no change in 
the pattern of distribution, by 2000 the propor- 
tion of the world’s population in each income 
group will be approximately as shown in Table 2. 
The proportion in countries with per capita GNP 
of less than $500 (at 1976 prices) is projected to 
fall from 57% in 1976 to 24% in 2000. 

One would expect such a shift in income levels 
to be accompanied by an improvement in 
national health status. On the basis of the ob- 
served correlation between national per capita 
incomes and national infant mortality rates (see 
the following section), one can roughly equate a 
per capita income level of $500 with an infant 
mortality rate of 45, and a per capita income of 
$1000 with an IMR of 30. On the basis of Table 
2, therefore, one would expect that by 2000 the 
proportion of the world’s population in countries 
with IMRs of 50:and over would have fallen to 
about 25%, with another 30% in countries with 
IMRs between 30 and SO. Since infant mortality 
is generally accepted as a good indicator of 
general health status, these projections imply 
that by the year 2000, 75% of the world’s 
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Table 2. Population of countries with more than | 
million population 1976: percentage distribution by 
— groups (GNP per capita), 1976 and projected 
000* 


- Population (%) 
GNP per capita Projected 

(1976 $) 1976 2000 
<100 2.1 1.0 
>100 22.5 1.0 
>200 32.4 21.6 
>500 5.1 31.3 
>1000 9.7 6.9 
>2000 14.6 9.6 
>5000 13.7 28.6 
Total 100.0 100.0 


se ——————— 


* Source: Data in World Bank Atlas (1978). Projections 
for 2000 assume income (GNP per capita) distribution 
in 2000 same as 1976; growth rate of world GNP per 
capita 1976—2000 same as 1960-1976. 


population will have attained approximately the Stage II countries are shown in Table 3. It can be 
status of the poorer European countries in 1960. seen that for India, for example, the estimate of 

The foregoing projections can be argued tobe _—per capita GDP on an exchange rate basis is 2.1% 
optimistic in that they assume a continuation of of that of the United States, whereas on a pur- 
the average growth rates of 1960-76. On the —_ chasing power basis the proportion is 6.9%. The 
other hand, they contain certain pessimistic change in valuation is greater for services (which 
elements in that they make no allowance for the do not enter into international trade) than for 
effect on per capita incomes of falling rates of — goods (which are generally tradeable, and whose 
population growth, and take no account of price ratios from one country to another are 
possible technical advances in medicine. On therefore reflected in the exchange rates); and 
balance, such projections seem to establish at there is a fairly consistent relationship between 
least the possibility that the health status of the the poverty of a country and the discrepancy 
populations of the developing countries will between the purchasing power and exchange rate 
improve substantially by the year 2000 even estimates. 


without massive diversion of resources to the However, this aspect of the results is of less 
health sector. significance than appears at first. It has never 
Direct national comparisons of purchasing power een supposed that the absolute value of income 
and their implications for health per capita was crucial in international com- 


Reference was made in the introduction to the parisons; of more importance Is the interpreta- 
development of international comparisons of real _ tion of the income estimates in terms “ wo 
product and purchasing power under a project and equity. On the side of equity, it snou 
supported by the World Bank and UN Statistical kept in mind that the purchasing ert al 
Office. The first report on this project, devoted parisons still show the distribution © a Fo Z 
to methodological issues and to preliminary between countries as being highly wing? es 
estimates of real GNP for 10 ‘Stage I’ countries, example, for the 16 Stage Il ints 4 ns 
appeared in 1975 (Kravis et al, 1975). A second to a purchasing power basis ye ener bg ‘ ir 
report, giving detailed estimates for 16 ‘Stage II’ coefficient of concentration Saeihe the : 
countries, appeared in 1978 (Kravis e¢ al 1978). from about 0.80 to about 0.75. ie’ of 
The most striking result of the project is the leaves - the ranking of a eands Ae 

apparent narrowing of the income gap between per capita GDP as almost a 1B pee Pa 
poor and rich countries which is produced by a On the welfare mye bie! ie eores 


shift from the ‘exchange rate’ basis of comparison imply that the leve ter than would have 


: a Vist ies is potentially grea 
to a ‘purchasing power’ basis. Estimates of per countries is P y ine rate-based com 


capita GDP in 1970 on each basis for the 16 been assumed from ¢€X 
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Table 3. Sixteen ‘Stage II’ countries: per capita GDP 


1970 as % US level, on 
chasing power basis* 


exchange rate basis and pur- 


Per capita GDP 1970 as % US level: 
Exchange rate Purchasing power 


- Country basis basis 
5 pe Te ne ee 
Kenya 3.0 6.3 
India py 6.9 
Philippines 3:9 12.0 
South Korea 5.4 12.1 
Colombia pe? 18.1 
Malaysia 8.1 19.1 
Iran 8.4 20.3 
Hungary 21.6 42.7 
Italy 35.9 49.2 
Japan 39.8 $9.2 
United Kingdom 45.7 63.5 
Netherlands 50.8 68.7 
Belgium eT aor 72.0 
France $8.3 732 
West Germany 64.1 78.2 
United States 100.0 100.0 


* Source: Kravis et al. (1978) Table 1.9. 


parisons, in that the volume of services is larger. 
They do not, of course, affect assessments of 
welfare based on non-economic indicators such 
as mortality and literacy rates. 

It should be pointed out that while the pur- 
chasing power basis of comparison removes one 
source of distortion in international comparisons, 
the figures are subject to other well known 
limitations as measures of welfare — for example, 
the exclusion of the value of the work of women 
within the home and the uncertainty about the 
welfare value to be attached to expenditure on 
the armed forces. 

It appears to be too early to assess the effect 
of the revised basis of comparison on rates of 
growth of real income. One would expect on a 
pron grounds that although the new estimates 
narrow the apparent income gap between poor 
and rich countries, they are also likely to reduce 
the apparent growth rates, with little overall 
effect on the time likely to be required for a 
country to move from one level of per capita 
real income to a given higher level. The limited 
data so far published suggest that this view may 
be too pessimistic, but the results are clearly not 
conclusive. 

It may be, therefore, that the main contri- 
bution of the techniques of purchasing power 
comparison to the study of development will be 
in permitting better analysis of the structure and 
functioning of particular sectors on an _ inter- 
national scale. Some possible lines of investigation 


are considered here in particular relation to the 
health sector; they include the balance between 
the public and private sectors, the structure of 
inputs and prices, and the overall efficiency of 
the heaith services. 


Balance of public and private sectors 
The data used in this and the following sections 
are taken from the most recent ICP report 
(Kravis et al. 1978) which gives estimates for the 
16 Stage II countries and for the years 1970 and 
1973, of expenditure in national currencies and 
at international prices on each of 153 subheads 
of the GDP, as well as for various groupings of 
these into broader heads. Seven sub-heads cover 
the greater part of expenditure on health care 
(drugs and medical preparations, medical supplies, 
therapeutic equipment, physicians’ services, den- 
tists’ services, nurses’ and other health workers’ 
services, hospitals). While in the main tables all 
expenditure on these items, public or private, is 
shown under the single heading of ‘consumption’, 
Table 2.1 of the report shows the expenditures 
which had been recorded in the national accounts 
of the countries concerned as part of Govem- 
ment Final Consumption Expenditure, and the 
expenditures taking place on these items under 
the national accounts heading Personal Con- 
sumption Expenditure can be obtained by 
difference. 

Table 4 shows the share of the government 
sector in health care expenditure for the 16 
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Table 4. Sixteen Stage II countries: Government expenditure as % 


expenditure) on health care, 1970* 


Drugs and 
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total expenditure (total final consumption 


Government as % total expenditure 


n Health Hospital 

Country supplies personnel services Total 
sm ny" >_> nomen eee emma er. + ent ee 
Kenya 6.5 47.1 47.2 41.1 
India 4.6 34.3 65.2 32.6 
Philippines 10.5 12.8 29.8 18.6 
South Korea 4.1 4.1 4.0 41 
Colombia = 34.6 14.6 19.3 
Malaya 17.0 12.4 66.4 56.5 
rss 15.8 18.8 15.8 15.8 
Hungary 82.1 93.9 92.6 91.0 
Italy 0.1 13.8 65.1 25.3 
Japan 9.9 60.8 12.9 22.2 
United Kingdom 59.8 89.2 98.9 81.6 
Netherlands 0.6 20.1 15.8 10.4 
Belgium 1 ba ley 33.6 85.9 39.9 
France 0.2 23-1 15.4 8.3 
West Germany 8.5 22.8 69.8 31.1 
United States 48.9 15.8 13.4 26.3 


* Source: Kravis et al. (1978), Tables 2.1, 4.1, 4.5. 


Stage II countries in 1970. This table relates 
to current expenditure only; no comparable 
breakdown is available on the side of capital 
expenditure. It can be seen from Table 4 that the 
share of the government sector in health care 
expenditure varies widely among the 16 countries 
(from 4% in South Korea to 91% in Hungary). 
No simple dichotomy into ‘public’ and ‘private’ 
national health systems appears possible. How- 
ever, Hungary and UK, with more than 80% of 
expenditure taking place through government, 
may reasonably be classed as predominantly 
public, while countries with less than 20% of 
expenditure through government (Philippines, 
South Korea, Colombia, Iran, Netherlands and 
France) can be considered predominantly private. 

Table 4 also shows the corresponding per- 
centage for three broad types of health care 
expenditure — on drugs and medical supplies, on 
the services of health personnel, and on the other 
costs of hospitals and health institutions. In all 
countries private expenditure forms a substantial 
proportion of expenditure on drugs, being as 
high as 18% even in Hungary, and exceeding 80% 
in all the developing countries in the table. The 
public share in the other two categories is gener- 
ally higher, and a country with a high public 
share in one category also tends to rate high on 
the other, but this tendency has some con- 
spicious exceptions. The breakdown by categones 
emphasizes the difficulty of classifying a coun- 


try’s health system as unambiguously ‘public’ or 
‘private’. 


Structure of inputs 

Expenditure at international prices provides a 
convenient basis on which to categorize the 
input structure of national health systems. The 
available data do not permit much disaggregation, 
but current expenditure can conveniently be 
broken down into three categories — drugs and 
supplies, services of health personnel, and running 
costs of hospitals and other health institutions. 
The second category can in tum be divided 
between physicians and dentists, and other 
health personnel. The proportionate importance 
of each category in total health care expenditure 
is shown for each country in Table 5. There 
is a clear tendency for the developing countries 
to rely less on drugs than the developed, 
but the balance between services and hospital 
expenditure shows no clear pattem. Within the 
expenditures for health personnel, the major 
share in all countries is attributable to the 
services of physicians, but there are two coun- 
tries, Kenya and Malaysia, which fall markedly 
below the average in this respect. These are the 
only two countries out of the 16 which place 
substantial reliance on health personnel other 
than physicians, and they are also the two 
developing countries with the highest govern- 
ment share in the health sector. It is possible that 
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Table 5. Sixteen Stage II countries: Expenditure on main categories of current inputs to health care as % total 


expenditure, 1970* 


Expenditure on 
physicians as 
% expenditure 


‘Expenditure at international prices as % 
total health care expenditure 


= Drugs and Health Hospital on health 
Country supplies personnel services personnel 
0 ITI” 

14.9 45.1 40.0 $2.3 
a = 2 Me 
Sou tities 30.4 63.0 6.7 84.7 
Colombia 11.6 58.0 30.4 83.4 
Malaysia 23.9 31.1 45.0 61.3 
Iran 54.5 35.6 9.9 90.8 
Hungary Zi 2 50.8 28.0 80.3 
Italy 32.9 36.3 30.8 93.8 
Japan S17 p 2) di | 25.6 80.7 
United Kingdom 36.1 33.6 30.4 76.7 
Netherlands - 43.2 27.3 295 81.1, 
Belgium 38.6 33,2 28.2 90.0 
France 59.6 25.4 15.0 83.7 
West Germany 35.1 36.4 28.5 86.3 
United States 38.2 41.8 20.0 76.9 


—————————  0( 0 0 O00 gg OOO OO LL—L— 
* Source: Kravis et al. (1978), Table 4.5. 


Table 6. Sixteen Stage II countries: Expenditures per capita on building of health institutions, at international prices, 
1970* 
A ee eee 


Expenditure on hospital building 1970 expressed as % of 


$ per capita Current Current Total 
(international hospital health capital 
Country prices) expenditure expenditure formation 
Kenya 0.76 15 6 1, 
India 0.41 18 4 0.8 
Philippines 0.58 12 5 0.8 
South Korea SLs 210 14 3.6 
Colombia 0.22 2 1 0.1 
Malaysia 3.37 23 10 1.6 
Iran 1.02 39 4 0.5 
Hungary 3:39 9 3 0.6 
Italy 5.24 12 4 0.8 
Japan 10.43 19 5 1.0 
United Kingdom 9.74 : 23 a 1.4 
Netherlands 39.86 79 23 4.1 
Belgium LZ 4 1 0.2 
France 17 25 a 0.7 
West Germany 17.84 34 10 i 
United States 13.47 38 8 1.4 


* Source: Kravis ef al. (1978), Appendix Table 4.5. 


Statistics such as these may form the basis of an 
indicator of the extent to which countries are 
orienting their health policies in the general 
direction of ‘primary health care’. 

The only health-related item of capital forma- 
tion on which the present data throw light is the 
per capita expenditure on the building of hos- 


pitals and other health institutions. This is shown 
in absolute terms in Table 6, and also in relation 
to current hospital expenditure, current health 
care expenditure and total capital formation. It 
can be seen that this item is in all cases small in 
relation to total capital formation and in very 
few cases does it appear substantial in relation to 
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total current health expenditure. This confirms items of expenditure the international dollar has 


the observation that the capital aspect of hospital the same purchasing power as the US dollar in 
and health centre construction in developing 1970. 


countries is not a serious direct constraint on 
health dtvelopment, in spite of the importance 
often attached to it in development plans and 
under overseas assistance; its importance for 
planning lies in its implications for future current 
expenditure and for the distribution of health 
resources. 


As an example, the relative price for health 
care for Kenya in 1970 on the basis of the report 
data was 0.42. This may be seen as reflecting the 
overall ratio of local prices (translated at current 
exchange rates) to international prices for the 
Kenyan GDP in 1970 — this ratio being 0.44: 


"v and the extent to which the price of health care 
The present data suggest a broadly similar —_ was lower, in relative terms, than the prices of 


input mix for all the countries examined, with other commodities and services making up the 
roughly equal proportions of expenditure (at GDP-—this being measured by the ratio of 
intemational prices) on drugs, services of health 0.42/0.44, or 95.5%. 
personnel and hospital running costs. There is Table 7 shows, for the 16 Stage II countries, 
some tendency for the developing countries to _ the price relatives for the GDP as a whole (ex- 
have smaller proportionate inputs of drugs than _— cluding capital formation), for current expendi- 
the developed, and it is also among the developing ture on health care, and for the three main 
countries that one finds examples of unusually — groups of current inputs into health care (drugs 
low inputs of physicians’ services compared with and supplies, services of health personnel, and 
those of other health personnel. However, the running costs of hospitals). In most cases the 
variations between countries in all respects are relative price of health care is less than that of 
more striking than the differences between the the GDP as a whole, but with certain clear 
developing countries as a group on the onehand, — exceptions (Philippines, Colombia, Iran, US). 
and the developed countries on the other. The relative price of drugs and supplies does not 
. arf . vary greatly as between the developing and 
Structure of relative prices | developed countries, while the relative price of 
The purchasing power comparisons in the 1978 the services of health personnel is very much 
report (Kravis et al. 1978) are based on extensive lower in the developing countries than in the 
collections of country prices, but the volume of developed countries (an exception is Hungary, 
this data is obviously much too great forittobe with a very low reported price of health per- 
reproduced in the report. However, the material | sonnel services). The relative prices of hospital 
published in the report can easily be manipulated services show no clear pattern of variation from 
to give relative prices, and it is these which form country to country, and indeed are so erratic as 
the basis of the analysis in this section. The pro- to suggest that the item may not be comparable 
cedure used is to take, for a given category of between countries. pee 
expenditure on GDP in a given country, the These data confirm the generalization that the 
expenditure in terms of the national currency prices of drugs are higher in relation to the | 990 
(Appendix Table 4.1 of the report), and to trans- of health personnel services in ning PE an in 
late it into US dollars on an exchange rate basis. developed countries. However, they : s 
The resulting dollar price is then divided by the — suggest the idea that ee pe - boe 
expenditure on the given category at international higher in developing countries. It ‘se “papa 
prices (Appendix Table 4.5 of the report) to give that the pattern of relative = ae Ger 
4 measure of relative prices. The relative price, in for health personnel ate 9 . coal vies 
this sense, may be seen as a reflection of two same as that for all goods ia ciated ae 
forces. One is the extent to which exchange rate suggesting that the seen * “9 Bee 
comparisons differ from comparisons at ‘inter- coe by factors not pec 
national’ prices; this effect varies from country sector. ; 
to ara but is the same for all items within a On’ general Sa ne he 
given country. The other factor is the differences expect the pattern 0 “$ ; 1 caiteintiae differ: 
within each country in the relative price struc- partial explanation ) ra aaa oc 
ture. The absolute levels of the international ences in input die wane tev pein 2 
prices used in the report are arbitrary since they ceding section. First, ys vanity of wealth car 
have been adjusted in such a way that over all given level of income, the q 
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Table 7. Sixteen Stage II countries: Relative prices for GDP (excluding capital formation), health care, and main 
categories of health inputs, 1970* 


Deanne TET TnIIn nema meme ee 
Relative prices 1970 


Total GDP (excluding 
= Drugs and Health Hospital health capital 
Country supplies personnel services care formation) 
Kenya 0.60 0.28 0.51 0.42 0.44 
India 0.44 0.11 0.09 0.18 0.29 
Philippines 0.49 0.38 0.15 0.39 0.29 
South Korea 0.30 0.14 0.96 0.25 0.43 
Colombia 22 0.40 0.43 0.50 0.40 
Iran 0.46 0.38 1.18 0.50 0.40 
Hungary 0.51 0.12 0.42 0.29 0.46 
Italy 0.76 0.61 0.21 0.56 0.76 
Japan 0.52 0.22 0.31 0.40 0.65 
United Kingdom 0.47 0.84 0.67 0.66 0.75 
Netherlands 0.63 = 1.34 0.11 0.67 0.77 
Belgium 0.62 1.36 0.36 0.79 0.77 
France 0.62 1.62 0.23 0.81 0.83 
West Germany 1.04 1.20 0.22 0.86 0.90 
United States ts 1.54 5-52 1.80 1.03 


* Source: Kravis et al. (1978), Appendix Table 4.1, 4.5. 
N.B. Relative price for US GDP 1970 = 1.00. 


services consumed would vary inversely with the 
price of such services relative to other items in 
the GDP. A test of this hypothesis was included 
in the 1978 ICP report (see Table 6.3, item 
“Medical Care’, and accompanying text) and the 
result of the test is positive — more so, indeed, 
than for most other items of consumption. 

As a second step, one can hypothesize that 
the use of the individual inputs to the health 
care system — drugs, physicians’ services, etc. — 
will vary inversely with their relative price. This 
also is tested in the 1978 report (Table 6.4), and 
the results again confirm the hypothesis, though 
at a lower level of statistical significance than for 
health care as a whole. The highest price elasticity 
is found in the case of drugs (—0.84) and the 
lowest in the case of dentists’ services (—0.15). 

One can go further and ask whether the data 
throw any light on the determinants of relative 
prices. Here the evidence is no more than sugges- 
tive, but it may be worth drawing attention to 
the fact that the two countries with state- 
controlled health care systems, Hungary and UK, 
appear to have lower relative prices for drugs 
than other countries of similar income level, and 
that among the developing countries drug prices 
appear to be relatively low in India and South 
Korea, which have substantial domestic pharma- 
ceutical industries. 


The price of the services of health personnel 
is largely determined by the price of physicians’ 
and dentists’ services, which account for about 
80% of expenditure under this head (lower per- 
centages are found only in Kenya, Malaysia, UK 
and US). The price of physicians’ services 
presumably reflects closely the incomes of 
physicians. By combining the ICP data with pub- 
lished data on population per physician, it is 
possible to make very tentative estimates of 
average incomes of physicians in each of the 
Stage II countries and relate them to per capita 
GDP. Very impressionistically, the results suggest 
that for high income countries the income of 
physicians is between 10 and 20 times the per 
capita GDP; for the lower part of the range of 
the developed countries it is 5—10 times the 
per capita GDP (for the UK, for instance, it 
appears to be about 5.5 times), while for the 
developing countries it varies very widely, with 
some suggestion that an important influence is 
the restrictiveness of the definition of physician. 
Thus physicians’ incomes appear to be much 
lower in India (with its relatively large numbers 
of domestically trained Western and Ayurvedic 
practitioners) than in Kenya, though the coun- 
tries have much the same level of per capita GDP. 

So far we have discussed the prices of current 
inputs to the health care sector. It is possible to 
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Table 8. Sixteen Stage Il countries: Relative prices of selected types of ca 


formation, 1970* pital goods and of total capital 


Relative price 1970 


Hospital Transport E i 
Country construction equipment wears on 

Se ee 
Kenya 0.55 0.61 
India 0.23 0.62 0-80 33 
Philippines 0.34 2.07 1.57 1.04 
South Korea 0.70 0.95 0.52 . 0.50 
Colombia 0.33 0.63 0.90 0.40 
Malaysia 0.28 0.73 0.85 0.42 
Iran 0.28 0.68 0.75 0.45 
Hungary 0.49 0.62 0.55 0.63 
Italy 0.78 0.61 0.54 0.65 
Japan 0.62 0.56 0.69 0.71 
United Kingdom 0.72 0.67 0.65 0.64 
Netherlands 0.61 0.85 1 0.67 
Belgium 0.80 0.81 0.72 0.75 
France 0.84 0.56 0.61 0.71 
West Germany 0.72 0.62 - 0.67 0.69 
United States 1.24 0.53 0.76 0.90 


* Source: Kravis et al. (1978), Appendix Tables 4.1, 4.5. 


use the ICP data to throw some light on the 
prices of capital goods. Table 8 shows the relative _ 


prices of three capital items relevant to the health 
sector — hospital buildings, transport equipment 
and electrical equipment. The conventional 
wisdom says that in developing countries capital 
is scarce, and therefore expensive, relative to 
other inputs. The data show that the situation is 
a little more complex than that. The relative price 
of transport and electric equipment is much the 
same for developing and developed countries. 
The price of hospital building construction 
(which includes a large labour component) is 
substantially less in developing than in developed 
countries, though with considerable variations 
within each category; to take the extreme cases, 
in India it is only one fifth that in the US. This 
suggests that one should be cautious in general- 
izing about the appropriate balance between 
capital and current inputs to the health sector 
in developing countries. 

At this point in the analysis it may be as well 
to emphasize that the ICP data were collected for 
aggregative purposes, and that in using them for a 
detailed examination of a particular sector we 
may be pushing them to the limit of what the 
data and methodology will bear. Nevertheless 
at least two broad conclusions seem permissible. 
One is that even as between developing countries, 
the economic dimensions of the health care 
sector — inputs, output and prices — are more 


varied than is sometimes allowed; the other is 
that a substantia! part of the variation may be 
explainable in terms of fairly obvious variables 
such as incomes, prices and the role of govern- 


ment. 


Efficiency of the health care sector 

The ICP purchasing power parity data enable us 
to measure the main inputs into the health care 
sector of the countries covered on a common 
basis of international prices. It seems natural to 
ask whether we can link such an input measure 
with a measure of output so as to obtain ar 
estimate of the efficiency of resource use. The 
output of the health care sector may be seer 
from at least two points of view. One is the 
consumer satisfaction obtained from the services 
provided; for this it does not seem possible to 
obtain an international measure which is in- 
dependent of the input side. From another 
point of view, the output of the health care 
sector is the health status of the population, and 
here there is a better hope of finding an in 
dependent and objective measurement, or at lexst 
a useful indicator. 

In the present section, for exploratory pur 
poses, the Infant Mortality Rate is used as such 
an indicator. It has been chosen because it is 4 
well-established statistic, available for most deve- 
loping countries, and believed to correlate well 
with other measures of current health status. 
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Table 9. Income-standardized proportionate measures of input morta- 
lity rate and of health care expenditure at international prices, 1970* 


Income-standardized proportionate rates 1970 


Health care expenditure 


Country IMR per capita 
Kenya 0.94 1.31 
India 0.99 1.18 
Philippines 1.01 0.52 
South Korea 0.59 112 
Colombia 1.80 0.81 
Malaysia 0.61 0.95 
Iran 2.96 0.69 
Hungary 1.33 1.36 
Italy 0.93 1.37 
Japan 0.49 1.87 
United Kingdom 0.94 0.86 
Netherlands 0.62 1.09 
Belgium - 1.00 0.76 
France 0.88 1.29 
West Germany 119 1.07 
United States 1.47 0.62 


* Sources: IMR — World Atlas of the Child, World Bank. 
Other — Kravis et al. (1978). 


Regression equations used to derive income-standardized rates: 
X = log, , (GDP [excluding capital formation] per capita, 1970) 


Y = log, (IMR 1970) 


y = 4.4701 + (—0.9316) x r= —0.8701 
X = log, , (GDP [excluding capital formation] per capita, 1970) 
Y = log,, (Health care expenditure per capita at international prices, 


1970) 


= —2.2018 + 1.3054 x r= 0.9581. 


Data used are for 1970 and have been taken from 


_ the World Bank’s ‘World Atlas of the Child’. 


For a meaningful calculation of efficiency it is 
necessary to make some assumption about the 
nature of the relation between inputs (expendi- 
ture on health care) and output (infant mortality 
as an indicator of health status). It is assumed 
here, on the basis of the literature and of pre- 
liminary calculations, that the most important 
determinant of health status is the country’s 
income level (as represented by GNP per capita), 
and that the regression of IMR on per capita 
GNP (both in logarithmic form) is linear. This 
regression relationship has been used to calculate 
for each of the 16 Stage II countries an IMR 
based on the country’s per capita GNP, and the 
observed IMR has been expressed as a proportion 
of this. Per capita health care expenditure at 
international prices is also highly correlated with 
per capita GNP, and a similar standardization 
procedure has been applied (Table 9). 

The data suggest, as one would expect, an 
inverse relation between the standardized pro- 


portionate health care expenditure estimates 
and IMRs. The simplest statistical procedure that 
shows a reasonable fit is again a linear regression 
in the logarithms, with a b value of —0.70 and an 
r? of 0.275. This can be interpreted to mean that 
about a quarter of the variance of the income- 
standardized IMR is accounted for by its 
association with the standardized health care 
expenditure, and that an increase of 1% in pro- 
portionate health care expenditure is associated 
with a decrease of 0.7% in the proportionate 
IMR. e9 

One possible summary measure of efficiency, 
attractive because it is dimensionless, is the ratio 
between the actual standardized IMR and the 
standardized IMR predicted on the basis of the 
above regression relationship. This is shown in 
column A in Table 10. The highest efficiency 
shown is for Malaysia (1.70) and the lowest that 
for Iran (0.44). While many of the values in the 
table appear plausible, some show deviations 
from what would be expected on general grounds 
which suggest defects in the underlying data. For 
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Table 10, Alternative measures of efficiency of health sector (see text)* 


Measures of relative health sector efficiency: 


————  — 


B Cc 
A X predicted IMR B 


predicted health care 


relative price of 
expenditure 


health care 


nen EEE ENSUES SSISSIEROSSSERSRERenemeneneemnen = 


A 
— 
Predicted/ 
Country actual IMR 
Kenya 0.88 
India 0.90 
Philippines 1.57 
South Korea 1.56 
Colombia 0.64 
Malaysia 1.70 
Iran 0.44 
Hungary ° 0.61 
Italy * 0,86 
Japan 1.31 
United Kingdom 1,18 
Netherlands 1°52 
Belgium 1:21 
France 0.95 - 
West Germany 0.80 
United States 0.95 


24.38 


10.24 
9.42 $2.33 
3.83 9.82 
2.98 11.91 
0.79 1.59 
2.14 7.12 
0.28 0.55 
0.12 0.41 
0.18 0.24 
0.16 0.40 
0.09 0.14 
0.13 0.20 
0.07 0.09 
0.06 0.08 
0.06 0.07 
0.03 0.01 


aes Rr ee eer 


* Sources: as for Table 9. 


Predicted IMR, Health Care Expenditure in Cols. B, C based on regression equations specified in 


Table 9. 


Predicted IMR in Column A based in addition on the following regression equation: 


X = log,, (income-standardized proportionate HCE 1970) 
Y = log,, (income-standardized proportionate IMR 1970) 


y = -0.0003 + (—0.7025) x 


r= -0.5247, 


example, a low value for Colombia is not un- 
expected, but the apparently high efficiency for 
Philippines does not seem to correspond with 
what is known of health service organization in 
that country. . 
While the above measure of efficiency is a 
useful exploratory device, for operational pur- 
poses one would prefer one which gave a more 
direct indication of the change in infant mor- 
tality to be anticipated from variations in health 
care expenditure, The standardized proportionate 
rates are misleading for this purpose since among 
developed countries the proportions are to be 
applied to low absolute levels of IMRs and high 
absolute levels of health care expenditure, and 
conversely for developing countries. If the ‘A’ 
measure of efficiency is adjusted by multiplying 
in each case by the (predicted) IMR and dividing 
by the (predicted) level of health care expendi- 
ture, we obtain the measures shown under B in 
Table 10. These can be interpreted as showing 
the reduction in IMR which would be brought 
about by applying an additional quantum per 


capita of health care resources in each country. 


(The quantum of resources is assumed to be 
represented by a given expenditure at inter- 
national prices.) For example, the reduction in 
IMR in Kenya would be approximately 300 times 
as great as in the US. 

For some purposes (e.g. for an international 
agency allocating a dollar budget among different 
countries) it would be relevant to take accoun: 
of the differing levels of prices of health carc 
inputs between countries. This can be done by 
adjusting the measures under B by the relative 
prices for health care inputs as a whole in eacl) 
country. Measures adjusted in this way are shown 
under C in Table 10. The estimates shown imply 
that, for example, a given dollar increase in pe’ 
capita health care expenditure would be 2400 
times as effective in reducing infant mortality in 
Kenya as in the US. | 

It should be emphasized that these estimates 
are highly tentative. Their use appears to be, first. 
as a means of checking the plausibility of the 
basic data (since inaccurate estimates of healt! 
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care expenditure and of IMRs are likely to show 
up in anomalous measures of efficiency); and 
second, as a step toward developing a predictively 
useful model of the relation between economic 
quantities, patterns of health service organization 
and national health status. 


Conclusions 


The data and discussion above seem to lead to 
two types of conclusions. There are, first, certain 


‘substantive conclusions about policy toward 


health development in the Third World, which 
can be summarized as follows: 


(a) Even using the presently available ap- 
proaches to health care, there is reason to expect 
substantial improvement in health status in the 
developing countries by the year 2000 based on 
the following factors: 

(i) the growth of per capita incomes for reasons 
extemal to the health sector, if this growth is 
comparable in magnitude with that which took 
place in the period 1960—1976; 

(ii) any additional increases in the per capita 
resources, current and capital, devoted to health 
care; 

(iii) improvements in the efficiency with which 
inputs are applied in the health sector so as to 
bring all countries upto the level of the presently 
most efficient (including a ‘levelling down’ of 
drug prices between countries and an economic 
balance between inputs according to their true 
relative scarcity). 


(b) Foreign assistance to the health sector 
will be most effective if it concerns current 
rather than capital inputs (since there is no 
evidence that the latter are a constraint on health 
development) and if it takes the form of money 
Or scarce equipment rather than the services of 
health personnel (since the latter are relatively 
cheap in developing countries). 
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These substantive conclusions can only be 
tentative given the limitations on the available 
data and on the resources so far devoted to its 
analysis. They therefore lead to certain further 
recomendations: 


(c) Efforts should be continued to improve 
the data on health inputs and outputs on the 
international scale. 

So far as economic data are concerned, this 
could most profitably be done by collaboration 
between agencies within the health sector (e.g. 
WHO’s current programme on the financing of 
health services) and agencies with a more general 
economic responsibility (e.g. IBRD, UNSO). 


(d) As further data become available they 
should be used to confirm, extend or refute the 
type of analysis carried out in this paper. This 
activity in turn would feed back to influence the 
direction of effort under (c). 


(e) Quantitative policy analysis should be 
regarded as a useful stage in the formulation of 
national and international health development 
programmes (e.g. “Health for All by the Year 
2000’) and not left entirely to academic research. 
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Summary: [n this study we describe the function of two health centres in Ain and Khusaiba 
villages in the Qasim region. It was part of a comprehensive survey in tae two villages. The 
study showed that the main function of the two health centres is to provide out-patient curative 
health services. Little is being done for prevention of diseases or for promotion of health. It is 
the medical education of physicians and of their assistants which is the main contributing 
factor behind their attitude and practice. 


Introduction 


This study aims at describing the function of two health centres in the villages of Ain 
and Khusaiba in the Qasim region. The two centres under study are not representative 
of other health centres in Qasim. However, evidence suggests that they are not 
different from others in Saudi Arabia (Sebai et a/. 1980). 

During the two-week stay in the villages the author, assisted by two students, 
studied the function of the two centres, observed the health personnel at work, 
scrutinized the records and interviewed people. The statistical data presented are 
mainly from the records of 15 working days in January 1980. 

Each of the two health centres under study is situated in a rented mud house. The 
10 rooms in each centre are used for clinics, a pharmacy, dressing rooms, and storage. 
Two rooms are kept as the residence for the female nurses. In Ain there is a small 
laboratory which is not functioning at present. The health services in the two centres 
are based on out-patient care with very few services extended to the community. 

Each health centre is staffed by 2 physicians (a husband and wife), two nurses and 
a pharmacy assistant. The two physicians working in Khusaiba are from Bangladesh, 
while the rest of the personnel in the two centres are from Arab countries (mainly 
Egypt). The only Saudi health worker is a male nurse in Ain. 

The four physicians in the two health centres are general practitioners who 
graduated about 1970. Their period of stay in the country varies from | to 5 years. 
Each of the other health personnel has a basic education of 9-12 years plus 2-3 years 
training. The Saudi nurse has only primary school education and no formal training. 

The physicians in charge of the health centres refer directly to the Regional Director 
of Health Services in Qasim. Two or three times a year an inspector from the Regional 
Office visits the health centres. 

The health services rendered by the two health centres will be discussed under two 
headings, curative and preventive services. 
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Curative Services 


Table | shows the age and sex distribution of those who attended the two health 
centres during 15 working days. The average number of daily attendances is 90 in 
Ain and 68 in Khusaiba. In summer the rate of attendance increases by 20%. Eighty 
per cent of those attending are Saudis. 

Although the two health centres serve 12 rural communities in an area of about 
750 km;, 66% of the people attending Ain Centre and 54% at Khusaiba Centre come 
from within a range of 5 km. Thirty-seven per cent are under |2 years of age which 
is low in a community where children constitute half the population. In general there 
are fewer females than males. It is likely that health services are most used by male 
adults. 

The time spent by the physician in seeing his patients was observed and recorded. 
On average the physician in Ain spent SO minutes seeing 21 patients (2-4 minutes 
per patient) and the physician in Khusaiba spent 25-6 minutes attending 17 patients 
(1-5 minutes per patient). On average, the physicians spent two minutes per patient. 

Further analysis of the time spent by the male physician in Ain shows that on 
average he spends 0-6 minutes for history taking, | -3 minutes for physical examination 
and 0-5 minutes for prescription writing and guidance of the patient. This is not 
different from the findings in a study of three health centres carried out in the western 
part of the country (Sebai et a/. 1980). 


Table 1 
Number of out-patients attending Ain and Khusaiba health centres in 
fifteen days 
eee 
Age groups 
0-12 years >12 years 
Male Female Male female Total 
nr hg nm pene oie ties Gt a 
Ain 245 202 459 443 1349 
Khusaiba 214 216 336 258 1024 
i ts We I Rae) 
Total 459 418 795 701 2373 


Forty-four patients (16 male and 28 female) were interviewed after they had been 
seen by one physician. Ninety-one per cent could not state the diagnosis of their 
ailments. They only mentioned their complaints. Fifty-two per cent did not know how 
to use the prescribed medicine properly. 

Table 2 shows the diagnoses of patients who visited the two health centres over 15 
days, as recorded in the physician’s book. Diagnosis is made on the basis of patient 
complaint and is recorded in general terms such as diseases of skin, eye, ear, kidney. 
etc. There is a lack of precision in recording: for example, ‘conjunctivitis’ in Ain is 
recorded as ‘eye disease’ in Khusaiba. 

The ratio of Ain to Khusaiba attendants is almost equal (1-3:1). One would not 
expect much difference in age and sex distribution or in specific health problems 
recorded at the two centres, since the two communities differ little in their health 
problems and population pattern. But in fact the recordings make a different picture: 
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Table 2 
Diagnosis of cases attending the centres in 15 working days (2373 cases) 


No. of patients 


Diagnosis Ain Khusaiba 
Common cold 63 224 
Tonsillitis Al . 85 79 
Diarrhoea 96 68 
Rheumatism 36 185 
Diseases of skin 100 77 
Bronchitis 293 
Conjunctivitis 212 

Moniliasis Sons! 43 

Colic 76 

Gastritis, hyperacidity 150 

General weakness 6] 

Measles 2 

Dysentery a3 89 
Hypertension — 9 

Pneumonia 15 
Disease of ear 42 
Disease of eye ) 13" 
Disease of tooth WIDE 
Disease of kidney | 8 
Bronchial asthma 8 
Communicable diseases — 2 
Chest pain | 5 25 
Others once 34 152 
Total 1349. 1024 


there are many diseases which are recorded in one health centre but not in the other, 
€.g. moniliasis, gastritis, general weakness and diseases of the ear, teeth and kidneys, 
etc. i ay ee ese. $04 POY Hea 

Table 3 shows the drugs prescribed in the two health centres over fifteen days. No 
common pattern exists between the two centres; whereas 5-5 items per patient were 
dispensed in Ain, 2-5 were dispensed in Khusaiba. Items such as tonics and vitamins, 
antispasmodics and antitussives were dispensed with wide differences between the 
two centres. ) ite 

In Ain, out of each 10. patients 9 received antibiotics and/or tonics, vitamins or 
iron. In Khusaiba, out of each 10 patients 8 received antibiotics and/or tonics, 
vitamins and iron. The figures reflect unjustifiable over-prescription of drugs. 

The differences in the number of drugs dispensed per patient in the two health 
centres (5-5 items in Ain and 2.5 items in Khusaiba) evidently arise from differences 
in the physicians’ attitudes, their submissiveness to the people’s demands and the 
availability of drugs. This is in addition to the lack of supervision and control. The 
large number of items dispensed for each patient is an observed pattern of practice 
among many physicians in the country. 
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Antibiotics, in the form of chloramphenicol, tetracycline, penicillin and septrin, 
were prescribed in large quantities and indiscriminately. Considering the short 
examination time, the lack of laboratory facilities for proper diagnosis and sensitivity 
testing and the patients’ ignorance of the proper use of drugs, we can perceive the 
possible hazards of indiscriminate prescription of such drugs. 


Table 3 
Drugs prescribed in the two centres in 15 days (2373 cases) 
w 


Ain Khusaiba 

Drug No. % No. % 
re ee ee Bee ne Sh i) a ee 
Antibiotics 1222 16-4 458 17-3 
Sulpha 103 1.4 35 1-3 
Tonics and vitamins 1164 15.7 208 7-9 
Iron . 230 3-1 16] 6-1 
Antispasmodic 407 5-5 6 0-2 
Analgesic 638 8-6 378 14.3 
Antidiarrhoeal 337 4.5 16 0-6 
Antitussive 762 10.2 32 1-2 
Antacid 291 3-9 19] 7.2 
Antiallergic 260 3-5 14] $-3 
Bronchodilator 147 2-0 9 0-3 
Sedative 1] 0-1 79 3-0 
Eye drops 317 4.2 40 1-5 
Ear drops 170 . 2-3 43 1-6 
Others 1401 18-8 851 32-1] 
SS ee 
Total 7460 100-0 2648 100-0 


a a a 


Preventive Services 


Preventive and promotive services expected from a primary health care unit in such 
a community can include health education, maternal and child health care, environ- 
mental sanitation, preventive dental care, nutritional programmes and recording of 
Statistics. None of these activities is adequately carried out. 

The vaccination records are incomplete in the two health centres. From a study on 
the number of children vaccinated in the area it was evident that fewer than 7% of 
the pre-school children have received complete coverage of polio and triple vaccines. 

The physician is prohibited from visiting the patients in their homes. Male physicians 
are not permitted by the Ministry of Health to Carry out vaginal examinations: this 
task is left for the female practitioner or the specialists in the hospitals. 

The only home visits made by the female nurses in the two centres are to attend 
mothers at birth. The twelve pregnant mothers who attended the Khusaiba Health 
Centre in one week received medicines for their present complaints. No antenatal or 
postnatal programme is carried out in cither of the two centres. Almost no other 
health services are carried out by the two hcalth centres. 
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Discussion 


A simple analysis of the work of the health centres shows that, on average, the four 
physicians see a total of 158 patients a day, with an average of 2 minutes per patient. 
This is equal to 1-3 hours of each physician’s time. It is evident that the procedure 
cannot have much effect on the health of the individual or the community. 

If we assume that each physician spends 2 hours on administrative work in addition 
to the 1-3 hours spent on clinical work, he or she will be left with about 4-5 hours 
free time per day (8 working hours per day for 5-5 working days per week). The 
same could be applied to the rest of the ten health personnel in the two centres. A 
simple caiculation indicates that total free time is 45 hours per day or 900 hours per 
month: ample time to operate a wide range spectrum of promotive health activities 
in the communities. 

None of the staff in the two centres has participated in a continuous education 
programme or attended a medical conference, with the exception of one of the 
physicians who attended a 7-day seminar on ‘war medicine’. None of the physicians 
receives medical journals or keeps a library in the clinic. They all feel the need for 
continuous medical education. . ) 

The physicians in the health centres have their own demands such as opportunities 
for continuous education, adequate financial and administrative authority and a 
recognition of their requests for needed drugs and medical supplies. 


Changes in the Health Centres 


A two-day visit was paid to the Al Asiah area 9 months after the completion of the 
study to collect more data and to see if any change in the health services had occurred 
in the two communities. Some definite improvements were observed in Ain village. 

After we had left Qasim the health centre personnel moved from the old rented 
building to the new building which we had occupied during the time of the project. 
The roomy building accommodated a new X-ray machine, a small laboratory, a dental 
clinic and ten maternity care and emergency beds. More personnel were required to 
run the service. 

The number of deliveries conducted by the 2 nurse-midwives in the centre increased 
from 3 per month to 25 per month. About 15 per month were conducted in the centre 
and the rest at home. The diagnostic capability of the two physicians in the centre 
is believed to have improved because of the laboratory and X-ray facilities. 

The recent recruitment of a well-trained Arabic-speaking health officer has been 
another positive influence. Each new-born child in Ain now has an immunization 
record and a well-maintained system of follow up is being initiated. People are aware 
of the importance of immunization for their children. Over 50000 tetracycline eye 
vintment tubes and 20000 bottles of sulfa eye drops were distributed among the 
people of Al Asiah to use in the family care system campaign against trachoma. 
Unfortunately, no records of their actual usage are being kept. 

The progress we observed in Ain village could be due to a combination of several 
factors almost all of which, we believe, came about as a result of our project: 


(1) The demonstration to the physicians and their staff of the practicality and need 
for delivering some aspect of preventive health service to the community. 

(2) The orientation of the people to their actual needs through health education 
programmes and their actuai participation in the project. 
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(3) The transfer of the health centre from the old rented building to a well-designed 
building, established for the purpose and with sufficient space, equipment and 
staff housing. 

(4) The recruitment of a well-trained. Arabic-speaking health officer to the Health 
Centre who has initiated immunization and sanitation programmes. 


In Khusaiba village we did not observe much change in the health centre’s activities, 
with one exception — the increased number of people demanding vaccination. There 
are, however, no accurate records or follow-up systems. The main difference between 
Ain and Khusaiba is that in Khusaiba the health centre remained in the old mud 
house, while in Ain the centre occupied the new building. 


Conclusion 


One needs little imagination to visualize the possible effect of primary health care on 
the people’s state of health if available human resources were efficiently and effectively 


-utilized. This could only be done if the health personnel werc being well-trained, 


adequately oriented towards their actual role in the community and capable of 
activating people to participate in health programmes. In brief, health services in 
these two rural communities are being influenced more than anything else by the 
medical education received by the physicians and health personnel. 

It is hoped that the Ministry of Health and the Regional Office in Qasim will make 
a careful study of the changes which have occurred in the health services of Ain 
village and use this information to reorganize the current system of primary health 
care. 

No doubt the new trends of the Ministry of Health in the decentralization of 
authority, regionalization of health services. concern for health manpower development 
programmes and more co-ordination with the Faculties of Medicine will lead to an 
improvement of health service svstems in the foreseeable future. 
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Distinguished participants, Ladies and Gentlemen, 


It gives me very great pleasure to welcome you all to this [nter-regional Consultation 
on Methodologies in Health Manpower Development Research as a part of Health Systems 
Research. 


I hardly need to reiterate to an audience such as this, that the achievement of 
effective health care for all must remain the basic and definitive goal of all HMD 
activities, including its research activities and that this should be seen as an integral 
part of Health Services Research. The very essence of the Health Manpower Development 
process is the provision of services needed for health care. Thus research in HMD must be 
oriented towards and indeed justified by the contribution it can make towards an improvement 
of nealth service system. 


The term Health Services Research has in recent times gained wide usage. However, it 
remains too broad and comprehensive to be dealt with in any but a most simplistic fashion 
and needs, I think, to be analysed into its component parts before it can be considered in a 
more meaningful manner. Each part can then be looked at, and provided that there is an 
effective integration and synthesis of research findings, it could lead to a more 
comprehensive understanding of what really contributes to the strength of, or weakens and 
impairs, the effectiveness of our health care systems. 


Every effort we make to characterize and classify the components and sub-systems of a 
system as complex as the health care system is fraught with some difficulties, but if we 


accept a more pragmatic position we can accept a categorization where the components are not 
independent entities ratner one whose interlocking and overlapping elements contain 
within them the whole range of health services research. The WHO Global Advisory Committee 
for Medical Research views Health Services Research as the "Systematic Study of the means by 
which basic medical and other relevant knowledge is brought to bear on the health of 
individuals and communities within a given context", 


A definition such as this would include several broad areas. First, “Studies on the 
health care system inclusive of areas such as assessment of needs, organization of delivery, 
management of organization and personnel, problems of costs, cost effectivenes and cost 
efficiency in relation to quality and quantum of care. Second, health manpower development, 
including planning and assessment of needs with reference to the required competence and 
distribution; planning, organization and evaluation of appropriate training programmes and 
the establishment of more systematic programmes of continuing education and cue 
strengtnening of team activities; problems relating to manpower management with at 
emphasis on problems relating to appropriate incentive schemes and career eh EY A. wi 
have to be solved if we are to ensure that health personnel remain responsive to healtt care 
needs, dedicated to, and able to function effectively in promoting health and Precis 
the prevention and care of disability and disease. Next, social, cultural ig Pye or 
factors. In this, perhaps the most undeservedly neglected area would lie 454 FA, apr 
to community aspirations, their value systems, life-styles and behaviours, in re 


the preservation and promotion of health. 
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Granted that the development target of Health for All provides the challenge, it must 
remain our principal point of reference and the overall goal of all involved in health 
care. Equally, all our research efforts must be devoted towards finding solutions to 
problems which impede the attainment of our goals. 


Nowhere is the need for a more radical reorientation, for the development of new 
approaches and strategies more urgent and demanding than in Health Services Research in 
general and in Health Manpower Development in particular, for health personnel represent the 
most important and costly resource in the provision of care. 


All of you, distinguished participants, will readily concede that the achievement of our 
goal cepresents a very fundamental challenge. You will concede that the formulation of our 
policies, the development of our plans, the adoption of our implementation Strategies is 
currently based, often on traditional practices and assumptions which well may not bear more 
critical scrutiny. You will concede that we deal with a large number of variables and 
"unknowns" and that therefore there is a very urgent need for the kind of research which 
will provide the necessary basis upon which sound decisions could be made; for enquiries, 
tne results of whicn can be applied to policy formulation, programming, planning and the 
implementation and evaluation of such policies and plans. Given this awareness, 
distinguished participants, why have our research efforts in these specific fields been so 
Sparing, why have our achievements been so modest? 


First, the problem of resource constraints. Admittedly the resources allocated for all 
health related research is small. Yet even within this allocation the resources made 
available for Health Services and Manpower Research are minute in comparison with that made 
available for the more conventional bio-medical and high technology research areas. This 
Situation must Surely serve as a reflection on priorities as they are currently perceived by 
decision makers. This must serve to remind us that the resistance to consider possible 


alternatives to present practices is one of the major constraints peculiar to applied health 
services research. 


Second, this prevaling ethos which accords Health Services and Manpower Research lower 
priority than that for research in new technology is also the result of the training which 
many senior health professionals have themselves received, and is reflected in an 
orientation towards basic scientific disciplines and curative technologies, training which, 
in emphasizing the precision, elegance and universality of the pure sciences have albeit, 
inadvertantly, made the conventional health professional doubtful, supercilious or at worst 


contemptuous of the role and validity of social and behavioural Science research. As a 
result human resources for health services research activities in social and behavioural 


Science areas are practically non-existent in many developing countries. 


It, therefore, gives me very great pleasure to invite all you distinguished participants 
to this meeting, for I am aware tnat all of you have been willing to give us the benefit of 
your expertise to assist us in making a beginning to remedy this situation. The problems of 
health services and manpower research have been identified, The inadequacy of the 
experimental method in solving many of our problems of this nature have been clearly 
demonstrated. The imperative need of the moment is therefore a clear and lucid exposition 
of the alternative research methodologies which are available, with a convincing 
demonstration of how such methodologies could be, and have been used, to solve problems of 


this nature, and have indeed in Some instances led to the adoption of Significantly better 
practices, 


I am confident tnat the outcome of your deliberations will take the form of a document 
which will be of invaluable benefit to all of us, not only to those of us who plan and 
manage research programmes, but much more to Senior Research Managers, Health Planners and 
Research Workers at the country level, who will gain new insights and experiences from your 


document and enable them to solve more competently the health care problems that are of most 
concern to them, 
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WE APPRECIATE YOUR OPINION 
Mame sncmabanMnuel cele! 


Your suggestions will be very much appreciated. Please take the time to 
answer the following questions. 


1. How important for your work is the main theme of this book 


extremely important important not very not:at.all 
important important 


2. Were the alternative research methods of interest to you? 


not interesting fairly interesting very interesting 


3. Were the methods well explained? 


2. Was the document the right length? 


about right too long 


6. Was the vocabulary (and the text in general) easy to understand? 


not always easy difficult 
[etten | [occasionally [never] 


8. Would you recommend other people in your country to read this document? 


| aetinitery ro] probably no probably yes | definitely yes | 


In the affirmative, please list them 


a EERE EE SS SA Nw OS Saver I a OA cine 0 
fog 8 Rate Sale eS in 2 tat eee 
ERRORS NE ES to Va aes Sax a eae ae ee 
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Now, some questions about you. This information is 


: - onfi . : 
help us in assessing the way in which this document confidential, but it will 


is being used. 


What is your position/job Dein eaetins cua ss 


What is your name CEM Naw les Ws book be a. 


$*9@ e080 0820 00000 n e®eereeeeeee 


What is your BOOP OOG iss cacy tabeecsscccacce. 


*$290802 96.663 a06 ahs 


Please post your suggestions to: 


Dr J.-J. Guilbert 

Division of Health Manpower Development 
World Health Organization 

1211 Geneva 27 

Switzerland 
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